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EVALUATION 


This  effort  has  significantly  advanced  and  refined  a  very  unique  and 
powerful  image  compression  technique  known  as  Micro-Adaptive-Picture- 
Sequencing  (MAPS) .  It  has  brought  the  Air  Force  one  step  closer  to  the 
realization  of  compressing  intelligence  imagery  with  excellent  results. 
This  technique  when  incorporated  within  the  design  and  production  of 
imagery  exploitation,  storage  and  retrieval,  and  distribution  systems  will 
render  the  Air  Force  major  cost  savings  due  to  reductions  in  hardware. 

The  effort  has  contributed  significantly  towards  accomplishing  goals  of 
Technical  Program  Objective  (TPO)  R2C. 


DOUGLAS  J.  PRASKA,  lLt,  USAF 
Project  Engineer 
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SECTION  ONE 
SUMMARY 


MICRO-ADAPTIVE  PICTURE  SEQUENCING  (MAPS)  is  a  digital  image  data 
compression  technique  which  originated  at  Control  Data  Corporation  and 
underwent  extensive  exploration  and  elaboration  with  sponsorship  from 
Rome  Air  Development  Center  under  contract  F30602-76-C-0350 .  The  effort 
and  results  described  herein  represent  the  next  major  phase  in  which  several 
further  MAPS  developments  and  evaluations  are  covered. 

1 . 1  OBJECTIVES 

Five  areas  of  MAPS  are  investigated: 

•  Adaptive  Decompression, 

•  Simplified  Micro-Fidelity  Specification, 

0  Error  Propagation  Protection, 

•  Interactive  Macro-Fidelity  Specification, 

0  Image  Processing  System  Implementation. 

The  objective  of  the  adaptive  decompression  task  is  to  develop  and 
refine  an  efficient  approach  to  removal  of  the  "blockiness"  artifacts 
present  in  the  MAPS  block  decompressed  imagery.  A  variable  "convolution" 
which  adapts  on  the  basis  of  the  local  pattern  of  element  sizes  and  in¬ 
tensities  is  explored  with  a  variety  of  weighting  functions.  Residual 
gray-scale  contouring  is  masked  using  a  small-amplitude  random  "dither". 
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The  objective  of  the  simplified  micro-fidelity  specification  task  is 
to  reduce  the  number  of  degrees  of  freedom  in  assigning  the  contrast  control 
matrix  and  to  develop  guidelines  for  selection  of  those  parameters  which 
remain.  The  simplification  is  to  be  achieved  without  sacrifice  of  significant 
fidelity  at  a  given  compression  level. 

The  objective  of  the  error  propagation  protection  task  is  to  assess 
and  optimize  the  error  detection  and  recovery  potential  inherent  in  the 
residual  redundancy  of  the  MAPS  resolution  codes.  Particular  attention  is 
applied  to  protection  from  "catastrophic"  errors  in  which  whole  subframes 
are  lost  or  inserted  destroying  the  large-scale  integrity  of  the  image. 

The  objective  of  the  interactive  macro-fidelity  specification  task  is 
to  explore  the  potential  for  describing  arbitrary  geometric  boundaries 
between  regions  with  different  fidelity  requirements.  Exploitation  of  the 
"transparency"  of  the  MAPS  decomnression  process  to  variation  in  the  fidelity 
control  on  compression  is  exploited.  The  implementation  is  to  be  inter¬ 
active  and  compatible  with  the  on-line  demonstration  of  the  final  task. 

The  objective  of  the  image  processing  system  implementation  task  is 
to  demonstrate  the  MAPS  technique  on  a  very  high  speed  processor.  Generic 
coding  considerations  for  microcode  implementations  are  emphasized  in  this 
development . 

1.2  BASIC  MAPS  CONCEPTS  -  A  BRIEF  REVIEW 

MAPS  is  basically  a  contrast-adaptive  variable-resolution  image  encoder. 
Detailed  description  of  the  technique  is  given  in  the  final  report  from  the 
prior  contract*.  Here,  the  two  central  concepts  of  contrast  adaptation  and 
constrained  local  resolution  variation  are  briefly  reviewed. 


*RADC-TR-77-405,  IMAGE  COMPRESSION  TECHNIQUES,  A.E.  LaBonte  and  C.J.  McCallum 
Control  Data  Corporation,  December  1977.  (A050679) 
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The  basis  of  MAPS  control  is  the  simple  "vision  heuristic"  illustrated 
in  Figure  1-1.  In  standard  PCM  matrix  or  raster  image  coding,  the  pixel 
size  is  uniform  throughout  the  image  and  the  resolution  is  fixed  by  the 
smallest  detail  to  be  displayed.  In  typical  imagery,  this  resolution  is 
required  only  in  very  localized  portions  of  the  image  and  the  remainder 
can  be  adequately  characterized  by  much  coarser  elements.  In  essence,  the 
heuristic  asserts  that  the  highest  resolution  is  required  only  at  points 
where  the  detail  exhibits  strong  contrast.  More  extended  structures, 
however,  are  perceived  at  much  lower  contrast.  Thus,  there  is  a  threshold 
locus  in  contrast-size  space  below  which  detailed  structure  is  "ignorable" 
and  resolution  may  be  reduced  until  this  threshold  is  exceeded. 

The  basis  of  MAPS  coding  is  the  variable  resolution  constraint 
illustrated  in  Figure  1-2.  Image  element  size  is  allowed  to  grow  only  in 
powers  of  four  (in  terms  of  original  pixel  count)  and  only  within  natural 
binary  boundaries.  Element  size  is  denoted  by  a  resolution  or  level  code 
which  has  the  form  log4  (original  pixel  count)  and  is  given  explicitly 
for  each  element  along  with  its  intensity  assignment.  Note  that  restriction 
to  elements  commensurate  with  the  natural  binary  boundaries  allows  the  element 
position  to  remain  implicit ;  it  is  implied  by  the  sequence  of  resolution 
codes  which  must  fit  together  in  a  directed  exhaustive  covering  of  the 
region.  Observe  also  that  the  log!,  integer  coding  provides  both  a  very 
compact  code  and  a  large  dynamic  range.  For  the  maximum  element  size  of 
16x16  used  here,  only  five  level  codes  (L=Q,  1,  2,  3,  4)  are  required  to 
cover  a  range  of  256:1  (4^=  1,  4,  16,  64,  256). 

The  two  concepts  illustrated  by  Figures  1-1  and  1-2  work  together  as 
follows : 


•  Elements  are  always  considered  together  in  groups  of  four 
which  are  the  subelements  of  a  potential  element  at  the  next 
higher  level  (that  is,  they  satisfy  the  implicit  sequence 
constraint) : 
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•  Contrast  measures  are  defined  as  intensity  differences  among 
the  four  elements; 

•  Contrast  thresholds  are  chosen  on  the  basis  of  the  level  or 
resolution  of  the  current  elements  and  the  contrast  measures 
are  tested  against  them; 

•  If  any  threshold  is  exceeded,  the  four  elements  are  left  at 
that  level;  if  no  threshold  is  violated,  the  four  elements  are 
combined  to  a  single  element  at  the  next  higher  level  and  a 
composite  intensity  (the  mean  of  the  four  subelements)  is 
assigned; 

•  The  process  requires  that  all  four  subelements  be  available 
before  transition  to  the  next  level  is  attempted; 

•  The  process  proceeds  through  the  source  image  in  a  sequence 
consistent  with  the  implicit  position  constraints  (see 
Figure  2-1,  shown  up  through  an  8x8  or  level  3  block); 

•  Element  composition  up  to  the  maximum  level  value  —  the  MAPS 
subframe  size  —  is  allowed. 

The  MAPS  process  thus  results  in  a  highly-nonlinear  adaptation  to  the  image 
scene  content  and  a  corresponding  compact  localized  coding. 

1.3  TEST  IMAGERY 

The  further  MAPS  developments  and  evaluations  undertaken  here  require  a 
diverse  set  of  test  imagery  to  insure  that  the  process  is  not  inadvertently 
"tailored"  to  a  specific  image  class.  The  image  test  set  is  displayed  in 
Figure  1-3.  The  samples  were  chosen  to  represent  a  wide  range  of  image  scale, 
image  type  (photo,  radar,  annotated  line  image),  scene  content  (natural 
versus  cultural),  and  contrast. 

Image  size  was  chosen  as  624  pixels/line  by  480  lines  to  insure  com¬ 
patibility  with  the  display  system  in  the  high  speed  image  processing  system. 
The  intensities  in  the  original  imagery  were  encoded  to  six  bits. 
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The  MAPS  process  is  clearly  sensitive  to  contrast  but  not  to  the  mean 
gray  scale  in  the  image.  Thus,  all  images  (except  the  topographic  map) 
were  adjusted  to  approximately  the  same  mean  to  ease  hardcopy  dynamic 
range  requirements  and  to  make  the  denominators  in  mean  square  error 
evaluations  more  comparable  from  image  to  image.  The  mean  and  standard 
deviation  (on  a  scale  of  0  -*  63)  for  each  image  before  and  after  the  scale 
shift  are  listed  in  Table  1-1.  Note  that  the  shift  did  not  result  in  any 
significant  reduction  in  the  standard  deviation  due  to  forced  saturation. 

1.4  RESULTS  AND  ORGANIZATION  OF  REPORT 

The  remainder  of  the  report  deals  with  each  of  the  task  areas  in  turn. 

A  brief  summary  of  the  key  results  in  each  area  is  given  below. 

Results  for  the  adaptive  decompression  effort  are  described  in 
Section  Two.  The  process  was  updated  to  include  an  efficient  table- 
driven  version  of  the  "convolution”  which  permits  an  arbitrary  set  of 
weighting  functions  to  be  included.  Four  cases  were  compared  with  the  basic 
block  decompression  mode  —  uniform,  pyramid,  "Markov",  and  Gaussian 
weighting.  In  all  cases,  the  adaptive  decompression  improved  the  mean  square 
error  (MSE)  over  that  for  block  decompression.  The  average  improvement  was 
just  over  11%  of  the  block  MSE  for  compressions  at  about  one  bit  per  pixel. 
The  weighting  function  for  best  improvement  varied  among  the  nine  test 
images  but  the  Gaussian  form  held  a  slight  overall  advantage.  In  any  event, 
the  range  from  least  to  best  improvement  over  the  weighting  types  was  only 
about  one  percent  of  the  block  decompression  MSE. 

Results  for  the  micro-fidelity  specification  simplification  effort  are 
described  in  Section  Three.  Direct  specification  for  the  sixteen  elements 
of  the  matrix  was  replaced  by  a  matrix  generation  procedure  in  terms  of  four 
parameters.  Experiments  with  the  test  image  set,  in  turn,  demonstrate  that 
three  of  the  four  can  be  assigned  "universal"  values  with  little  loss  in 
fidelity  performance  at  fixed  compression.  Moreover,  the  range  of  choice 
of  these  universal  values  is  quite  wide  giving  credence  to  the  assertion 
that  they  will  be  applicable  to  imagery  beyond  that  represented  by  the 
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TABLE  1-1.  TEST  IMAGE  STATISTICS 


IMAGE 

MEAN 

SOURCE  DATA 

STANDARD 

DEVIATION 

REVISED 

MEAN 

TEST  SET 

STANDARD 

DEVIATION 

GRAND  CANYON 

35.4 

15.32 

26.4 

15.30 

AERIAL  PHOTO 

17.5 

7.20 

22.5 

7.20 

AIRFIELD 

31.9 

18.85 

26.0 

18.81 

POWER  PLANT 

42.6 

8.57 

26.6 

8.50 

SAM  SITE 

18.1 

8.84 

24.1 

8.83 

BUILDING 

50.7 

7.32 

24.7 

7.32 

IEEE  GIRL 

33.2 

15.36 

26.2 

15.34 

RADAR  SCENE 

21.3 

8.59 

21.3 

8.59 

TOPOGRAPHIC  MAP 

9.9 

6.86 

9.9 

6.86 

test  set.  Thus,  control  is  simplified  to  selection  of  a  single  quantity  — 
the  overall  contrast  scale.  Although  this  remaining  parameter  appears  to 
be  strongly  image  dependent,  one  "rule  of  thumb"  for  its  selection  did 
emerge:  Given  the  compression  at  one  contrast  scale  value,  the  compression 
at  another  scale  is  approximately  C2  =  Cj  (T2/T1).  Here  C  is  the  compression 
in  bits  per  pixel,  T  is  the  contrast  threshold  scale,  and  exponent  a  depends 
somewhat  on  the  "universal"  values  chosen  for  the  other  generator  parameters. 

The  error  propagation  protection  effort  is  described  in  Section  Four. 

The  resolution  codes  are  revised  so  that  the  last  element  in  each  MAPS  sub- 
frame  is  designated  by  a  termination  code.  The  code  space  is  then  assigned 
such  that  any  single-bit  error  in  a  termination  code  is  immediately  detected 
as  an  illegal  code  and,  correspondingly,  no  other  legitimate  level  code 
can  be  converted  into  a  false  termination  code  via  a  single-bit  error.  This 
process  is  then  strengthened  by  invoking  a  universal  constraint  which  must 
be  satisfied  by  the  element  count  between  termination  codes.  Together 
these  processes  imply  that  a  net  of  three  undetected  false  terminators 
must  be  added  within  one  subframe  or  a  string  of  three  successive  legitimate 
terminators  must  be  deleted  before  a  catastrophic  subframe  position  error 
will  arise.  Note  that  this  entire  process  is  achieved  at  no  change  in  the 
basic  MAPS  compression  level.  Beyond  this  level  of  catastrophic  error 
protection,  the  local  error  detection  potential  of  the  inherent  MAPS 
resolution  consistency  relations  is  formulated  in  terms  of  an  allowed- 
level  constraint  map.  Finally,  guidelines  for  data  reorganization  are 
outlined  for  cases  where  more  elaborate  external  error  control  is  to  be 
adued. 

Results  for  the  interactive  macro-fidelity  specification  and  image 
processing  system  implementation  efforts  are  highly  intertwined  and  are 
covered  together  in  Section  Five.  Descriptions  of  the  image  processing 
system,  the  MAPS  microcode  implementation,  and  the  user  operating  procedures 
are  outlined  in  the  text  and  elaborated  in  Appendices  A,  B,  and  C.  Although 
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Che  dynamics  of  Che  process  cannoc  be  capCured,  several  examples  in  Che 
form  of  direcC  phocographs  of  Che  video  screen  are  included.  The  speed 
enhancemenC  of  Che  image  processing  sysCem  implemenCaCion  relacive  Co 
MAPS  on  a  large-scale  high-speed  general  purpose  compuCer  is  observed  Co 
be  abouC  20:1! 

Finally,  Che  MAPS  Cechnique  has  reached  a  level  of  maCuriCy  which 
suggescs  Che  preparaCion  of  a  "cransporCable  sofcware"  package  wriccen  in 
a  high-level  language,  probably  FORTRAN.  SecCion  Six  concludes  Che  reporC 
wiCh  recommendacions  for  Che  user  opCions  which  such  a  package  should  conCain. 
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SECTION  TWO 

ADAPTIVE  DECOMPRESSION 

The  potential  for  adaptive  decompression  of  the  MAPS  data  stream  is 
based  on  the  additional  information  implied  by  the  MAPS  resolution  codes. 

Two  concepts  are  central  to  this  adaptation.  First,  for  the  region  within 
a  MAPS  element,  the  element  size  (keyed  explicitly  by  the  resolution  code) 
gives  a  measure  of  the  "correlation  length"  in  that  region.  This,  in  turn 
implies  an  appropriate  size  for  an  adaptive  convolution  window  to  be  used  in 
resampling  the  image.  Second,  the  relative  size  of  the  MAPS  elements  (again 
keyed  by  the  resolution  codes)  gives  a  direct  measure  of  the  image  "activity 
level"  in  the  area.  Small  elements  encode  significant  local  structure  and 
should  not  be  included  in  the  resampling  used  to  smooth  nearby  larger 
elements . 

2.1  Adaptive  "Convolution"  Process 

In  view  of  the  observations  above,  adaptive  decompression  mode  based 
on  a  resampling  and  smoothing  convolution  is  a  natural  adjunct  to  MAPS. 

Four  major  dimensions  to  the  adaptivity  have  been  identified.  They  are: 

•  Convolution  window  size, 

•  Element-size  resampling  thresholds, 

•  Convolution  weighting  functions,  and 

•  "Dither"  selection. 

Adaptation  for  each  of  these  is  a  function  of  the  MAPS  resolution  code  for 
the  target  element  and  its  surrounding  elements. 
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The  geometry  for  the  process  is  exhibited  in  Figure  2-1.  Based  on  the 
correlation  length  argument,  the  convolution  window  size  should  be  chosen  to 
approximate  the  size  of  the  target  element.  In  addition,  it  should  be 
symmetric  about  the  target  pixel.  A  window  edge  which  is  chosen  to  be 
one  pixel  less  than  the  target  block  edge  satisfies  these  conditions. 

This  yields  window  sizes  of  lxl,  3x3,  7x7,  and  15x15  for  levels  one  through 
four  respectively. 

Note  that  restriction  to  a  window  size  no  larger  than  the  target 
block  has  another  significant  advantage.  As  seen  in  Figure  2-1,  the  target 
pixels  in  each  quadrant  interact  with  only  part  of  the  surround: 

Target  pixel  quadrant  Active  regions  in  window 

I  0  12  3  5  7 

II  0  2  3  4  6  8 

III  0  5  7  9  10  11 

IV  0  6  8  10  11  12 

Moreover,  element-size  resampling  thresholds  apply  to  the  MAPS  elements 
surrounding  the  target  element  and  operate  on  the  relative  difference 
between  target  and  surround  resolution  codes.  If  only  elements  no  smaller 
than  one  level  below  the  target  or  central  block  are  actively  used,  then 
each  of  the  twelve  surround  regions  has  a  uniform  MAPS  input  intensity. 

As  a  consequence  of  the  window  size  and  activation  restrictions,  each 
convolution  will  have  at  most  six  independent  MAPS  inputs.  This  gives 
significant  potential  for  improving  the  convolution  efficiency. 

The  activation  restriction  is  also  motivated  by  the  scene  structure. 

The  presence  of  MAPS  elements  smaller  than  one  level  below  the  central 
block  is  a  priori  evidence  of  more  detailed  and  localized  image  structure 
which  should  not  be  permitted  to  contaminate  the  target  pixel. 
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Figure  2-1.  Adaptive  Decompression  Geometry 


The  adaptive  "convolution"  (a  conflict  in  terms  since  the  window  and 
activation  adaptation  destroy  spatial  invariance)  is  implemented  as  a 
table-driven  process.  Since  each  convolution  depends  on  only  six  independent 
quantities,  the  weights  can  be  presunmed  for  each  target  pixel  location  and 
stored  as  six-component  vectors  addressed  by  the  target  position.  For  the 
15x15  window,  for  example,  the  convolution  is  reduced  from  225  multiplies 
and  adds  to  6  multiplies,  adds,  and  activation  level  comparisons  —  a 
dramatic  improvement  in  implementation.  In  this  table-driven  form,  an 
arbitrary  weighting  function  over  the  window  can  be  supplied  to  the 
presum  operation.  From  there  on,  the  process  is  independent  of  the  weight 
form. 

More  detailed  descriptions  of  the  weighting  functions  and  dither 
addition  are  covered  in  the  next  two  subsections. 

2.2  WEIGHTING  FUNCTIONS 

Four  different  weight  functions  —  uniform,  pyramid,  "Markov,"  and 
Gaussian  —  were  used. 


2.2.1  Uniform 

With  uniform  weighting,  the  target  pixel  depends  equally  on  all  active 
pixels  within  the  window.  The  input  weighting  functions  for  levels  two, 
three,  and  four  are  shown  in  Figure  2-2  for  the  uniform  case. 

2.2.2  Pyramid 

With  pyramid  weighting,  the  contribution  of  each  active  pixel  decreases 
linearly  with  the  larger  of  its  x  or  y  separations  from  the  target  pixel. 

The  pyramid  input  weight  function  is  displayed  in  Figure  2-3. 
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Figure  2-2.  Uniform  Weighting  Function 
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Figure  2-3.  Pyramid  Weighting  Function 


2.2.3  "Markov” 

Tonal  imagery  is  often  modelled  as  a  first  order  Markov  process  with 

a  high  correlation  coefficient  between  adjacent  pixels.  A  weighting  function 

£ 

in  which  each  contribution  is  weighted  by  p  where  p  is  the  correlation 
between  adjacent  pixels  and  6  is  the  distance  from  the  target  pixel  (in 
units  of  the  interpixel  spacing)  was  also  implemented.  The  weighting 
functions  for  p=  0.9  are  shown  in  Figure  2-4. 

2.2.4  Gaussian 

Finally,  a  Gaussian  weighting  in  which  the  center  to  corner  distance  is 
2a, was  employed.  Note  here  that  a  varies  with  the  local  block  size  which 
is  consistent  with  the  concept  that  this  size  is  a  measure  of  the  correlation 
length..  The  Gaussian  weighting  functions  are  given  in  Figure  2-5. 

2.3  DITHER 

With  the  convolution  process,  the  blockiness  of  the  image  is  removed 
but  the  discrete  quantization  of  the  intensities  still  leaves  a  residual 
gray-scale  contour  pattern.  The  addition  of  dither  is  largely  a  cosmetic 
process  to  mask  this  contouring  and  the  amplitude  must  be  sufficient  to 
cover  the  boundaries  but  small  enough  not  to  blur  or  obliterate  real 
image  features. 


The  effectiveness  of  the  dither  is  critically  dependent  on  the  point 
in  the  process  at  which  it  is  added.  The  convolution  process  will 
typically  yield  a  non-integer  value  for  the  smoothed  intensity  and  the 
dither  should  be  added  to  this  value  prior  to  requantization  to  the  final 
gray  scale  value.  In  this  manner,  the  density  of  pixels  of  each  quantized 
level  will  shade  gradually  from  one  gray  scale  to  the  next.  In  this  case 
a  dither  amplitude  of  two  gray  scale  levels  is  typically  sufficient. 
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Figure  2-5. 


Gaussian  Weighting  Function 


2a  in  Corner 


Each  particular  dither  addition  is  simply  drawn  as  the  next  output  from  a 
pseudo  random  number  generation  routine. 


2.4  COMPARISONS  AND  EXAMPLES 


The  results  of  the  adaptive  decompression  experiments  are  summarized 
in  Table  2-1  which  lists  mean  square  error  (MSE)  values  for  each  of  the 
nine  test  images  under  each  of  the  weighting  schemes.  Note  that  block 
decompression  can  be  included  under  this  formalism  by  interpreting  the 
weighting  pattern  as  a  delta  function.  The  mean  square  error  is  defined 
as : 

Nj  N.  r  2  / Njj  N  2 

MSE  =  Z  Z  [M(k,  i  )  -  I(k,  J?  )]  /  Z  Z  [l(k,  J?  )J  , 

i=l  k=  1 ,  '  i-1  k=  1 

(2.4-1) 

where  I  is  the  original  image  intensity,  M  is  the  corresponding  MAPS 
decompressed  intensity  and  the  sums  extend  over  all  pixels  in  the  image. 

All  compressions  are  about  6:1  or  approximately  one  bit  per  pixel. 
Relative  to  the  block  decompression,  the  various  adaptive  decompressions 
all  show  improvement  in  the  MSE  values.  The  mean  improvement  is  on  the 
order  of  11.5%  of  the  block  MSE  and  the  spread  among  the  various  adaptive 
weightings  is  typically  less  than  1%  of  the  block  MSE.  Thus,  the  overall 
effect  of  adaptive  decompression  is  significant  but  the  choice  among 
weighting  functions  is  much  less  so.  The  Gaussian  shows  a  slight  edge  on 
seven  of  the  nine  images.  Since  the  only  difference  involves  the  initial 
specification  of  the  weights  pattern,  no  computational  cost  is  incurred  by 
choosing  the  more  complex  function. 

Finally,  the  effect  of  additive  dither  (with  uniform  weighting)  is 
included  in  the  last  column  of  Table  2-1.  Note  that  the  MSE  values  with 
adaptation  and  dither  are  very  similar  to  those  for  the  original  block 


decompression.  Visual  comparisons  are  provided  by  Figures  2-6  (block 
decompression)  and  2-7  (adaptive  decompression  with  dither).  Suppress 
of  blockiness  is  particularly  noticeable  in  the  GRAND  CANYON,  AERIAL 
PHOTO,  SAM  SITE,  and  TOPOGRAPHIC  MAP  images. 


IEEE  GIRL  RADAR  SCENE  TOPOGRAPHIC  MAP 

PDPPTIVE  DECOMPRESSION  DITHER  =  2.0 


SECTION  THREE 

CONTRAST  CONTROL  SIMPLIFICATION 

The  basic  MAPS  control  matrix  for  the  selected  subframe  size  of  16x16 
original  pixels  involves  four  level-transition  thresholds  for  each  of  four 
contrast  types.  Thus,  each  matrix  requires  specification  of  sixteen 
elements  and  a  new  matrix  must  be  chosen  each  time  the  macro-fidelity 
requirement  is  changed.  The  goal  of  this  task  is  to  establish  guidelines 
for  selection  of  the  matrix  elements  using  fewer  degrees  of  freedom. 

3.1  THE  CONTRAST  CONTROL  MATRIX 

MAPS  contrast  control  is  illustrated  by  Figure  3-1.  The  control 
operation  always  deals  with  the  four  already-formed  subelements  of  a  potential 
MAPS  element.  The  process  proceeds  as  follows: 


•  The  four  intensities  are  sorted  by  increasing  intensity; 


•  Four  contrasts  are  defined  as, 
"extreme"  contrast 

"middle  step"  contrast 

"lower  step"  contrast 

"upper  step"  contrast 


the  difference  between  the  lowest 

and  highest  intensity, 

the  difference  between  the  two 

middle  intensities, 

the  difference  between  the  two 

lowest  intensities,  and 

the  difference  between  the  two 

highest  intensities; 
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•  Each  contrast  is  tested  against  a  corresponding  threshold 

addressed  by  the  contrast  type  and  the  level  transition 
involved. 

The  qualitative  behavior  desired  for  the  thresholds  is  illustrated  in 
Figure  3-2.  In  general,  the  threshold  decreases  with  increasing  level 
transition  or  element  size,  and  the  "interior"  contrast  thresholds  are 
smaller  than  the  extreme  threshold.  Moreover,  the  middle  step  threshold 
is  typically  smaller  than  those  for  the  lower  and  upper  steps.  (These  con¬ 
clusions  were  established  in  the  previous  MAPS  contract  efforts.) 

3.2  GENERATOR  PARAMETERS 


The  qualitative  threshold  behavior  described  above  can  be  generated 
parametrically  from  a  simple  model  involving  four  degrees  of  freedom. 

The  dimensionality  reduction  proceeds  by  partitioning  the  dependence 
on  resolution  code  (the  level  transitions)  and  on  contrast  type  into  two 
independent  factors.  Empirical  experience  indicates  that  the  resolution 
code  dependence  is  one  in  which  the  transition  thresholds  fall  exponentially 
with  increasing  MAPS  level.  If  i  denotes  the  resolution  code  (level 
transition  from  i  to  i+1)  and  B  denotes  the  "taper"  or  base  for  the  exponential 
decay,  then  this  factor  is  B  \ 

The  contrast  type  dependence  requires  that  the  various  "step" 
contrasts  -  middle,  lower,  upper  -  are  some  fraction  of  the  extreme 
contrast.  Further,  the  "middle  step"  is  biased  to  a  slightly  smaller  than 
average  fraction  while  the  lower  and  upper  step  thresholds  are  equal  and 
slightly  larger  than  average.  If  F  represents  the  fraction  and  A  the  bias, 
the  middle  step  factor  is  F(l-A),  relative  to  the  extreme  threshold  and 
the  upper  and  lower  step  factors  are  both  F(l+A). 
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The  only  remaining  parameter  is  an  overall  threshold  scale  factor,  T  . 

o 


Combination  of 

all  these 

terms 

then  yields 

T 

Extreme 

(i  -*•  i+1 ) 

=  T 

0 

B-i 

i  =  0,  1,  2,  3, 

(3.2-1) 

TMiddle 

(i  +  i+D 

=  T 

0 

B_i 

F( I-A) , 

(3.2-2) 

TLower 

(i  +  i+1) 

=  T 

0 

B-i 

F( 1+A) , 

(3.2-3) 

T 

Upper 

(i  -+  i+1) 

=  T 

0 

B-1 

F( 1+A) . 

(3.2-4) 

Equations  (3.2-1)  through  (3.2-4)  define  the  sixteen-element  MAPS  contrast 
control  matrix  in  terms  of  four  parameters:  the  taper,  B,  the  step  fraction, 
F,  the  step  bias.  A,  and  the  threshold  scale,  Tq. 

3.2.1  Exponential  Taper  Base  Trade-Offs 

Based  on  prior  empirical  experience,  F  and  A  were  fixed  initially 
at  0.5  and  0.1  respectively.  Extensive  exploration  at  five  different  values 
of  the  taper  —  B  =  1.5,  2,  2.5,  3,  3.5  —  was  then  undertaken.  Several 
hundred  compression  runs  varying  the  source  image,  the  taper,  and  the 
contrast  scale  were  made  to  establish  the  trade-off  data  base.  The  results 
were  then  analyzed  in  terms  of  the  MSE  by  image  at  fixed  compression 
levels.  The  MSE  values  for  C  =  0.6  bits/pixel  are  listed  in  Table  3-1  and 
plotted  in  Figure  3-3.  From  analyses  of  this  type,  the  following 
observations  were  drawn: 

•  The  optimum  exponential  taper  base  (B)  for  control  matrix 
generation  is  essentially  imagery  independent. 

•  The  optimum  taper  base  is  essentially  compression  independent 
(at  least  over  2.0  to  0.25  bits  per  pixel,  the  approximate 
range  examined). 
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Figure  3-3.  Mean  Square  Error  vs  Taper  Base 


The  mean-square-error  (MSE)  fidelity  measure  at  fixed 
compression  shows  a  very  shallow  minimum  as  a  function  of 
taper  base  near  B=2.5.  Anywhere  within  the  range  from  B=2.0 
to  B=3.0  appears  reasonable. 

Subjective  evaluation  of  decompressed  images  at  one  fixed 
compression  (C  a>0.6  bits/pixel)  suggests  that  visual  fidelity 
is  slightly  better  toward  B=3.Q  rather  than  at  the  taper 
(B&2.5)  corresponding  to  minimum  MSE. 


For  the  subjective  evaluation,  compressions  as  close  as  possible  to 
C=0.6  bits/pixel  where  decompressed  and  photo  written  for  each  of  the  nine 
test  frames  at  each  of  four  tapers  (B=2.Q,  2.5,  3.0,  and  3.5).  Exact 
compression  values  cannot  be  reached,  of  course,  because  the  coding  is 
image  adaptive  based  on  contrast  fidelity  control.  However,  the  mean 
compression  over  the  thirty-six  image-taper  combinations  was  C  =  0.601  bits 
per  pixel  with  a  standard  deviation  of  Cc  =  0.016  bits  per  pixel  (2.6%).  The 
worst  case  was  only  5.6%  away  from  the  target  compression.  This  imagery  is 
displayed  as  Figure  3-4. 


The  final  observation  above  is  based  on  light  table  examination  of 
the  resultant  positive  transparencies  of  the  decompressed  images.  As 
the  taper  is  increased,  the  contrast  scale  (Tq)  must  also  be  raised  to 
maintain  fixed  compression.  Thus,  the  thresholds  for  very  small  elements 
are  increased  while  those  for  the  largest  elements  decrease.  In  essence, 
some  small  high  contrast  detail  is  sacrificed  to  improve  the  fidelity  of 
mid-sized  lower  contrast  features.  Since  the  very  smallest  elements  are 
relatively  so  expensive  to  preserve,  deletion  of  a  small  amount  of  fine 
detail  results  in  large  gains  in  the  mid-range.  This  appears  to  be 
the  source  of  the  visual  preference  for  tapers  slightly  above  those 
giving  the  optimum  MSE. 
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The  following  key  conclusion  is  supported  by  these  observations: 

A  UNIVERSAL  MAPS  EXPONENTIAL  TAPER  MAY  BE  CHOSEN. 

A  sample  of  the  parametric  change  in  taper  base,  B,  for  one  of  the 
test  images  is  given  in  Figure  3-5.  Note  that  the  compression  vs  contrast 
scale  relation  changes  systematically  with  taper  but  the  function  is  not 
particularly  smooth  within  a  fixed  taper.  This  will  be  discussed  more 
extensively  at  the  end  of  this  section.  All  of  the  curves,  however,  are 
approximately  log-log  linear  so  no  significant  preferred  value  for  this 
taper  is  implied. 

3.2.2  Step  Fraction  and  Outer/Middle  Bias  Trade-Offs 

Four  test  frames  -  AERIAL  PHOTO,  AIRFIELD,  IEEE  GIRL  and  TOPOGRAPHIC 
MAP  —  were  chosen  for  the  F  and  A  explorations.  The  taper  base,  B,  was 
fixed  at  3.  Nine  combinations  of  F  and  A  were  used: 

F  ®  0.4,  0.5,  0.6} 

A  *  0.0,  0.1,  0.2. 

For  each  test  image  at  each  (F,A),  the  contrast  scale,  Tq,  was  searched  to 
yield  a  compression  as  close  to  0.6  bits  per  pixel  as  possible.  The  thirty- 
six  samples  finally  chosen  were  then  photowritten  as  positive  transparencies 
for  visual  inspection.  These  images  are  presented  as  Figure  3-6. 

The  mean  square  error  (MSE)  versus  compression  curves  show  even  less 
variation  over  this  (F,A)  range  than  the  very  weak  variation  observed  as 
a  function  of  B  (at  fixed  F  and  A).  Visual  examination  also  reveals  no 
marked  (F,A)  effects  although  each  extreme  value  exhibits  slightly 
discernible  relative  degradation  on  one  or  more  of  the  test  scenes.  From 
these  observations,  the  following  conclusion  is  drawn: 

UNIVERSAL  VALUES  OF  STEP  CONTRAST  FRACTION,  F=0.5,  AND 
MIDDLE-OUTER  STEP  BIAS,  A=0.1,  ARE  APPROPRIATE  FOR 
MAPS  CONTRAST  CONTROL  GENERATION. 
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Thus,  only  the  contrast  scale,  T  ,  remains  imagery  dependent  —  a  significant 
reduction  in  control  dimensionality  from  sixteen  parameters  to  one! 


3.2.3  Contrast  Scale  Dependence 


The  variation  of  the  compression  level  with  the  contrast  scale,  Tq, 
is  illustrated  for  fixed  (B,  F,  A)  in  Figure  3-7.  Here  the  test  image 
scene  is  parametric.  Note  that  the  curves  are  all  approximately  linear 
and  approximately  parallel  in  this  log-log  space.  As  a  consequence,  the 
data  base  was  analyzed  to  obtain  linear  least-squares  fits  of  log  C  vs 
log  Tq  for  each  image  at  each  taper  with  (F=0.5,  A=0.1).  The  results  are 
listed  as  Table  3-2  in  terms  of  the  slope. 


Given  any  two  (compression,  contrast  scale)  pairs. 


fit  corresponds  to  a  relation 


the  linear  log-log 

(3. 2. 3-1  ) 


where  a  is  the  tabulated  slope.  Given  a  selection  for  the  taper,  relation 
3. 2. 3-1  becomes  a  "rule  of  thumb"  for  extrapolating  one  (C,  Tq)  pair 
to  another.  The  corresponding  mean  slope  from  Table  3-2  is  a  reasonable 
first  estimate  for  the  exponent,  a.  Finally,  note  that  taper  B=3  yields 
a»-l  or  CTq  approximately  constant. 
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TABLE  3-2.  LEAST  SQUARES  SLOPE  OF  LOG  C  (BITS/PIXEL)  VS.  LOG  T 
WITH  TAPER  BASE  PARAMETRIC 


Image 

1.5 

Taper  Base,  B 

2.0  2.5  3.0 

3.5 

Grand  Canyon 

-1.28 

-1.50 

-1.15 

-1.20 

-1.10 

Aerial  Photo 

-1.65 

-1.40 

-1.18 

-1.07 

-0.95 

Airfield 

-1.15 

-0.96 

-0.88 

-0.81 

-0.77 

Power  Plant 

-1.49 

-1.26 

-1.13 

-1.04 

-0.97 

Sam  Site 

-1.75 

-1.37 

-1.15 

-1.00 

-0.94 

Building 

-1.17 

-1.05 

-0.97 

-0.86 

-0.84 

IEEE  Girl 

-1.27 

-1.04 

-0.94 

-0.89 

-0.76 

Radar  Scene 

-1.75 

-1.56 

-1.27 

-1.10 

-0.98 

Topo  Map 

-1.06 

-0.87 

-0.89 

-0.84 

-0.80 

Mean 

Sigma 


-1.22 

0.25 


-1.06 
0. 14 


-0.98 
0.  13 


-0.90 

0.11 
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SECTION  FOUR 

RESOLUTION  CODE  ERROR  DETECTION  AND  RECOVERY 


There  are  three  levels  of  MAPS  errors: 

•  intensity  errors, 

•  intrasubf rame  position  and  resolution  errors, 

•  intersubframe  position  errors. 

These  are  ordered  by  increasing  significance  with  the  last  class  potentially 
catastrophic.  However,  the  MAPS  resolution  codes  retain  some  natural 
redundancy  which  implies  an  internal  consistency  which  can  be  used  for  partial 
error  checking.  Here  that  redundancy  will  be  organized  to  emphasize  pro¬ 
tection  against  long-range  intersubframe  error  propagation. 

The  basic  MAPS  element  (or  "MAPSel")  is  localized  as  a  compound  word 
with  N  intensity  bits  and  K  resolution  or  level  bits.  Typically,  N  is  six 
or  eight  and  K  is  three  for  a  16x16  pixel  subframe  partition.  However, 
only  five  of  the  eight  codes  available  from  these  three  bits  are  required  — 
those  corresponding  to  levels  0(1x1),  1(2x2),  2(4x4),  3(8x8),  and  4(16x16). 
Codes  for  these  levels  need  not  be  assigned  to  their  natural  binary  represen¬ 
tations.  Moreover,  when  there  are  no  errors  within  the  subframe,  the  level 
for  the  final  element  in  the  subframe  is  implied  by  the  number  of  original 
pixels  remaining  to  be  described  by  that  element.  Thus,  the  normal  level 
code  for  the  final  MAPSel  may  be  replaced  by  a  "subframe  termination" 
code.  Note  that  this  process  does  not  use  up  any  additional  code  values 
because  the  level  four  resolution  code  will  be  converted  to  the  terminator  — 
it  is  the  last  and  only  element  in  the  subframe. 
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The  recommended  code  assignments  are  L=Q-»-0,  L=l-*lf  L=2->-2,  I.=3-*4,  and 
terminator  (including  L=4)  +  7.  This  assignment  is  depicted  geometrically 
in  the  code  "cube"  of  Figure  4-1.  There  the  motivation  for  the  assignments 
can  be  seen  more  clearly: 

•  All  codes  above  level  zero  are  "Hamming  distance  2"  apart  — 

at  least  two  bits  of  three  must  be  in  error  before  any  two 
of  these  codes  are  interchanged, 

•  All  codes  are  "Hamming  distance  2"  or  more  away  from  the 

terminator  —  any  single  bit  error  in  a  terminator  is 
immediately  detected  as  an  illegal  code, 

•  Level  zero  is  only  1  bit  different  from  each  of  levels  one, 

two,  and  three  but  level  zero  MAPSels  must  come  in  strings  of 
four  —  this  information  can  be  invoked  to  detect  -  errors  in 
interchanges  of  level  zero  with  other  allowed  codes. 

Note  that  the  termination  code  is  thus  "protected"  at  the  one-bit  error 
level,  both  in  terms  of  addition  of  terminators  by  erroneous  conversion 
from  ocher  legitimate  codes  and  from  undetected  deletion. 

The  subframe  integrity  can  be  increased  significantly  by  exploiting 
another  global  constraint  on  the  MAPS  level  patterns.  Each  time  a  higher 
level  MAPSel  is  formed  it  replaces  four  MAPSels  at  the  immediately  prior 
level.  Hence,  each  composite  element  formation  results  in  a  net  decrease  of 
three  in  subframe  MAPSel  count.  For  a  16x16  subframe,  the  count  ranges  from 
256  at  full  resolution  down  to  one  MAPSel  at  complete  reduction.  Only  values 
of  the  form  (3j+l),  j=0,  1,  ...  85,  are  allowed  for  c'ne  total  subframe  count. 
Expressed  in  a  slightly  different  form,  "the  MAPSel  count  between  terminators 
must  be  one  of  eighty-six  multiples  of  three".  This  implies  that  a  string 
of  three  terminators  would  all  have  to  be  lost  (and  the  total  element  count 
of  the  three  would  have  to  fall  below  the  bound)  before  such  deletion  would 
be  undetected.  Analogously,  a  total  of  three  false  terminators  would  have 
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Figure  4-1.  Resolution  Code  "Cube" 
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to  be  inserted  between  two  legitimate  terminator  before  such  addition  would 
be  undetected.  Moreover,  each  would  have  to  be  inserted  in  the  stream  at 
positions  satisfying  the  "multiple  of  three"  requirement  —  this  has  an  a 
priori  conditional  probability  of  (  1  / 3 )  3  =  0.037  given  the  three  false 
terminators  in  the  interval.  Note  that  a  combination  of  the  loss  of  a 
legitimate  terminator  and  insertion  of  a  false  terminator  (satisfying  the 
"multiple  of  three")  could  also  go  undetected.  In  this  case,  the  error 
would  propagate  across  the  t  i  rst  subframe  boundary  but  not  across  the  second 

Together,  the  intracodc  separat ion/detection  and  the  intra/inter  sub- 
frame  "multiple  of  three"  relation  represent  a  capability  similar  to  a 
horizontal  and  vertical  parity  system  operating  with  emphasis  on  terminator 
integrity  protection.  Moreover,  this  is  all  achieved  at  no  cost  to  the 
basic  MAPS  compression  performance. 

In  addition  to  checking  for  simple  illegal  codes,  the  MAPS  resolution 
level  consistency  requirements  can  be  further  exploited  for  local  error 
detection.  Given  a  legitimate  position  in  the  subframe,  only  certain 
resolution  levels  (and  codes)  are  allowed  for  the  next  MAPSel.  The  allowed 
levels  are  summarized  in  Figure  4-2(a)  and  the  corresponding  codes  (with 
the  terminator  included)  in  Figure  4-2(b).  An  erroneous  code  may  violate 
the  constraint  and  be  detected  immediately  or  it  may  throw  off  the  phase  of 
the  inferred  position  with  respect  to  the  true  position  and  result  in  a 
violation  later.  When  an  illegal  code  is  encountered,  the  various  allowed 
codes  may  be  tried  in  the  order  of  their  "distance"  from  the  observed  value. 
Together,  the  code  assignment  and  constraint  map  provide  a  significant  local 
detection  and  recovery  potential. 

All  techniques  above  take  advantage  of  constraints  and  redundancy 
already  present  in  the  basic  MAPS  code.  If  the  environment  is  very  noisy, 
addition  of  further  redundancy  for  error  detection  and  correction  is  reqv.i’ei 
Retention  of  the  predictability  of  pos i t ion  of  the  resolution  data  in  the 
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bit  stream  is  still  required  which  means  that  a  uniform  element  format  is 
mandated.  However,  since  additional  redundancy  is  to  be  included,  that 
associated  with  the  unused  level  codes  might  first  be  eliminated.  Note 
that  each  code  requires  log2  5=2.32193  bits  (rather  than  three)  and  a 
combination  of  resolution  codes  for  three  elements  can  thus  be  described  in 
6.9658  bits  ( 5 3=  125  <  1 28=2 7 ) .  Thus  a  seven-bit  code  can  be  used  as  the 
basic  resolution  element  (rather  than  three  three-bit  codes).  The  coding 
then  gives  this  seven  bit  quantity  augmented  by  some  error  correction  bits 
plus  three  N  bit  intensity  values  as  the  basic  MAPS  data  packet. 

Alternatively,  several  seven  bit  representations  of  three  resolution  codes 
may  be  strung  together  and  protected  by  a  more  elaborate  code  (but  with 
fewer  bits).  Note  that  multiples  of  seven  bits  are  required  until  90  cells 
have  been  joined  wherein  209  bits  (rather  than  210)  would  suffice. 

One  very  simple  alternative  with  the  three  cell/seven  bit  combination 
involves  a  single  parity  bit  with  each  triple.  This  makes  an  eight-bit 
resolution  code  format  or  a  thirty-two  bit  intensity/resolution  code  packet 
if  there  are  N=8  intensity  bits  per  MAPSel.  This  is  a  particularly 
attractive  size  for  many  current  digital  systems.  Note  that  the  compression 
ratio  is  actually  increased  a  little  in  this  case  (by  33/32).  The  individual- 
element  code  separation  has  been  lost  here  but  an  explicit  local  parity 
check  has  been  established  on  three  elements.  Moreover,  use  of  the 
"multiple  of  three"  termination  interspace  relation  and  the  next-resolution- 
code  constraint  map  are  preserved.  Note  finally  that  for  a  burst  error 
environment,  the  resolution  code  bits  may  be  interleaved  with  the  intensity 
bits  to  reduce  their  adjacency  (at  the  cost  of  packing  and  unpacking 
manipulations).  For  the  three-MAPSel/thirty-two  bit  packets  described 
above,  resolution  code  bits  may  be  placed  in  every  fourth  location. 
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SECTION  FIVE 

ON-LINE  MAPS  DEMONSTRATION/ 

INTERACTIVE  MACRO-FIDELITY  CONTROL 


The  MAPS  compression  and  block  decompression  techniques  were  implemented 
on  a  high  performance  image  processing  system.  A  user  can  load  any  image 
into  the  system,  from  tape,  film,  or  disk.  Compression  parameters  can  be 
input  to  the  system,  and  in  less  than  2  seconds  the  system  can  compress  and 
decompress  the  image.  The  display  facility  allows  the  user  to  view  both  the 
original  and  the  processed  image  in  a  variety  of  display  modes,  including 
zoom,  split-screen,  and  with  color  graphics.  Macrofidelity  control  is 
implemented  using  a  trackball  to  create  arbitrary  areas  for  fidelity  control. 
Up  to  four  different  Tq  parameters  may  be  specified  to  allow  four  levels  of 
fidelity  in  the  processed  image.  These  capabilities  allow  the  user  to  see  the 
efficiency  and  adaptability  of  the  MAPS  technique.  The  rapid  processing 
allows  the  user  to  experiment  quickly  with  different  compression  parameters 
and  see  the  trade-offs  between  compression  and  fidelity. 

5.1  IMAGE  PROCESSING  SYSTEM  DESCRIPTION 

The  image  processing  system  consists  of  a  CDC  1700  system  linked  to  a 
four-flexible-processor  (FP)  array.  The  1700  provides  high-level  language 
programming  and  operating  system  functions  to  host  the  FP's.  The  FP  array 
provides  for  general  purpose  display  functions  such  as  trackball  operation 
and  generation  of  scan  conversion  parameters.  Additionally,  the  FP  provides 
high  speed  computation  for  real  time  image  processing  such  as  MAPS.  A  block 
diagram  of  the  system  is  shown  in  Figure  5-1. 
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Figure  5-1.  Image  Processing  System 
Block  Diagram 


The  1700  system  consists  basically  of  a  1700  central  processor,  two 
tape  drives,  two  disk  drives,  a  C.R.T.,  and  an  optronics  scanner,  with 
their  associated  controllers.  This  system  provides  utilities  to  aid  in  FP 
microcode  checkout  and  to  perform  I/O  for  the  FP  array.  Utilities  exist  to 
transfer  imagery  from  tape  or  film,  via  the  scanner,  to  the  FP  array  and  to 
load  microprograms  into  the  FP's.  These  utilities  can  be  called  directly 
by  the  operator  or  they  can  be  called  by  a  FORTRAN  driver.  Additionally  the 
1700  is  used  to  create  and  maintain  the  library  of  microcode  which  is  used  in 
the  FP  array. 

The  heart  of  the  image  processing  system  is  the  Scan  Converter  Memory 
(SCM)  and  the  FP  array.  The  SCM  can  hold  more  than  a  half  million  bytes  of 
image  data  and  drives  a  640  x  512  color  monitor;  additionally  the  color 
conversion  and  raster  map  can  be  changed  up  to  30  times  per  second.  The 
display  controller  (DC0N)  routine  provides  user  interaction  with  SCM  by 
user  microci  de  overlays,  by  low-speed  channel  (LSC)  trackball  and  keyboard 
input,  or  by  1700  input.  Also  linked  to  the  FP  array  is  a  storage  module 
drive  (SMD)  which  can  hold  more  than  60  mil1 ion  bytes  of  image  data.  This 
allows  the  user  to  roll  images  in  and  out  of  SCM  in  about  2  seconds.  Using 
DCON ,  imagery  can  be  displayed  in  a  variety  of  modes  including  zoom,  split¬ 
screen,  and  color.  In  addition,  graphics  can  be  overlayed  on  imagery.  A 
more  complete  description  of  the  FP  and  SCM  is  given  in  Appendix  A. 

Microcode  was  developed  to  perform  both  the  on-line  demo  and  macro¬ 
fidelity  control  tasks.  The  on-line  demo  is  incorporated  in  the  macro¬ 
fidelity  control  program.  This  allows  the  user  to  input  up  to  four  Tq 
parameters  and  arbitrarily  assign  one  of  the  corresponding  contrast  control 
matrices  (CCM's)  to  each  block  in  the  image,  then  compress  and  decompress  the 
image  and  display  the  compression  ratio.  The  original  and  processed  images 
are  stored  separately  in  SCM  so  that  both  can  be  viewed.  Using  the  display 
facilities  of  DCON,  the  images  can  be  independently  zoomed  and  viewed  using 
split-screen;  and  displayed  using  a  variety  of  color  look-up  tables.  The 
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SCM  and  microcode  can  be  loaded  using  INDIAN2  utilities.  INDIAN2  is  the 
1700  display  control  software  which  complements  DCON  in  the  FP  array. 

5.2  MAPS  MICROCODE  SOFTWARE 

The  code  which  performs  the  MAPS  compression  and  decompression 
consists  of  5  parts:  an  executive  (MAPX),  a  read  routine  (REDB),  a  com¬ 
pression  routine  (COMB),  a  decompression  routine  (DECB),  and  a  write 
routine  (WRTB).  MAPX  requires  a  512  pixel  x  480  line  x  8  bit  image  stored 
in  SCM  as  input.  The  lower  5  bits  of  the  pixel  are  treated  as  the  image  and 
the  upper  3  bits  are  ignored.  The  output  of  MAPX  is  a  512  pixel  x  480  line  x 

8  bit  image  in  SCM  where  the  lower  5  bits  of  a  pixel  are  the  image  grey 

scale  and  the  upper  3  bits  are  the  resolution  code  of  the  parent  MAPS 
pixel.  The  other  four  routines  operate  at  the  block  (16  pixels  x  16  lines) 

level..  Input  to,  and  output  from,  each  routine  is  a  block.  The  flow  of 

data  is  summarized  in  Figure  5-2. 

The  operation  proceeds  at  about  35.3  instructions/pixel  overall.  An 
enhanced  version  could  run  at  about  25.6  instructions/pixel.  All  the 
enhancements  would  require  more  LF  storage  and  instruction  memory. 

5.2.1  Flexible  Processor  I/O  (REDB,  WRTB) 

The  (I/O)  routines  REDB  and  WRTB  basically  perform  two  functions; 
transferring  data  to  and  from  SCM  and  converting  raster  format  to  and  from 
MAPS  order.  Additionally  REDB  clears  the  top  three  bits  of  the  pixels  and 
communicates  macrofidelity  control  information  to  MAPX.  This  allows  these 
three  bits  to  be  used  for  graphics.  Both  routines  were  written  to  operate 
near  the  bandwidth  of  the  SCM;  approximately  2  instructions/pixel.  WRTB 
runs  at  about  3.0  instructions/pixel  and  REDB  runs  at  about  3.7  instructions/ 
pixel.  REDB  is  slower  due  to  the  clearing  of  the  top  bits  of  the  pixels. 


Figure  5-2.  MAPS/FP  Data  Flow  Chart 
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5.2.2  MAPS  Compression  (COM3) 

COMB  is  the  heart  of  the  MAPS/FP  implementation  and  uses  a  different 
algorithm  to  perform  compression  than  its  FORTRAN  predecessors.  The  input 
to  COMB  is  in  MAPS  order  and  the  output  of  COMB  is  not  bit-stream.  The 
purpose  of  creating  this  new  algorithm  was  to  find  a  fast  implementation  for 
the  FP.  This  meant  keeping  the  number  of  conditional  jumps  to  a  minimum 
and  using  sequential  rather  than  random  access  to  pixels  in  large  file  (LF). 
COMB  achieves  this  by  using  an  iterative  rather  than  recursive  algorithm 
and  performing  the  pixel  sort  with  a  look-up  table.  The  result  is  that 
COMB  operates  at  about  25.4  instructions/input  pixel,  and  further  enhancements 
could  lower  the  rate  to  about  17  instructions/input  pixel. 

In  order  to  develop  a  fast  compression  routine,  an  iterative  compression 
algorithm  using  a  new  sort  was  developed.  The  pixel  sort  is  implemented 
using  a  look-up  table  rather  than  the  tree  sort  used  before.  A  tree  sort 
requires  4.67  differences  on  the  average;  however,  in  some  cases,  an 
additional  difference  is  required  for  contrast  control  comparisons. 

Actually  5.33  differences  are  required  on  the  average.  The  new  sort  takes  all 
six  differences  of  four,  taken  two  at  a  time,  and  forms  a  6  bit  address 
from  the  sign  bits.  This  is  the  address  in  a  look-up  table  of  the  extreme, 
middle,  high,  and  low  step  differences  required  for  contrast  control  com¬ 
parison.  This  method  requires  no  conditional  jumps  where  a  tree  sort  requires 
4.67  on  the  average.  In  order  to  make  the  algorithm  iterative,  COMB  makes 
4  passes  over  the  data.  Previously,  pixels  were  stacked  pending  further 
compression;  COMB  does  all  compression  at  one  level  before  compressing  at  the 
next  level,  thereby  eliminating  the  stack.  The  COMB  algorithm  is  shown  in 
Figure  5-3.  These  changes  were  made  to  eliminate  all  random  access  to 
pixels  in  LF. 

5.2.3  MAPS  Block  Decompression  (DECB) 


DECB  performs  block  decompression  on  compressed  pixels.  Its  operation 
is  a  straightforward  extension  of  the  FORTRAN  versions.  Additionally  DECB 


//COMB// 


START 


LOOP  1 


P«-l ;  //PASS  NUMBER// 
n+O ; 

A+O;  //LF  address;  (LF)  E  contents  of  location  A  in  LF // 
n-»-n+ 1 ; 

Pi-^(LF)  ;  A+A+a;  //P.,  i=  1  —4  are  the  4  pixels  to  compress// 
P2*-(LF)A;  A+A+a; 

P3+-(LF)A;  A*-A+a; 

P„^(LF)A; 

if  [all  4  pixels  P1-P4  are  not  level  p-  f]  then  go  to  LOOP  I; 
sort  pixel  and  locate  E,  M,  H,  6  steps; 

if  [Extreme  threshold  violated^  then  go  to  L00P1; 

if  [Middle  threshold  violated  J  then  go  to  LOOP  I; 

if  [Low  threshold  violated  J  then  go  to  L00P1; 

if  [High  threshold  violated  J  then  go  to  L00P1; 

<LF)a  -  Pi  +  P2  +  P3  +  P4  +  2)  /  4  +  $20; 

//  $  20  is  the  hexadecimal  value  used  to  increment  // 

//  pixels  from  level  p-1  to  level  p  // 

A-*-A+a ; 

if  [n  <  4  ^  then  go  to  START;  //  pass  not  complete// 

if  fp  =  4]  then  EXIT; 

p  *■  p  +  1 ;  //  start  next  pass  // 

n  ■*-  0  ; 

A  +  0 

a  4  (P‘J); 
go  to  START; 

Figure  5-3.  MAPS/FP  Compression  Routine  //COMB// 
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accumulates  a  compressed  pixel  count  for  compression  ratio  calculation. 
DECB  runs  at  about  3.2  instructions/output  pixel  and  could  be  enhanced  to 
run  at  about  2.1  instructions/output  pixel. 


5.2.4  Macro-Fidelity  Control 

The  code  to  perform  macrofidelity  control  is  largely  nvolved  in  calling 
routines  in  DCON  which  perform  display  and  arithmetic  primitives.  These 
routines  perform  character  generation,  line  drawing,  clearing  character 
lines,  turning  the  cursor  on  and  off,  clearing  specific  bits  in  each  pixel, 
and  multiplication  and  division.  Additional  primitive  routines  were  developed 
for  converting  fixed  point  binary  numbers  to  ASCII  strings  and  vice  versa. 

The  mechanism  used  to  communicate  Tq  values  to  the  compression  routine  for 
macrofidelity  control  uses  the  top  2  bits  of  the  pixel  in  the  original  image. 
These  bits  perform  two  functions:  transmitting  Tq  values,  and  designating 
the  color  to  appear  in  the  outline  of  each  block.  Drawing  the  colored  outline 
around  a  block  during  area  definition  actually  sets  the  top  2  bits  of  those 
pixels  making-up  the  colored  lines.  The  REDB  routine  transmits  these  2  bits 
to  COMB. 

Special  coding  considerations  are  elaborated  in  Appendix  B  and 
comment-annotated  microcode  is  given  in  Appendix  C. 

5.3  USER  OPERATIONS  AND  OPTIONS 

A  feeling  for  the  general  image  manipulation  and  display  capabilities 
available  to  the  user  can  be  obtained  from  a  review  of  Figure  5-4.  The 
controls  and  commands  described  therein  can  be  used  in  concert  with  the  more 
specific  MAPS  processes  called  from  the  display  console.  The  MAPS  operation 
consists  basically  of  two  parts:  initialization  and  interaction. 
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TABLE  0  -  imagery  end  graphic*  for  IMAGE  1 

TABLE  1  -  imagery  only  for  IMAGE  1  and  2 

TABLE  2  -  imagery  with  level  0  pixel*  in  green  for  IMAGE  2 

TABLE  3  -  imagery  with  level  1  pixel*  in  red  for  IMAGE  2 

TABLE  4  -  imagery  with  level  2  pixels  in  magenta  for  IMAGE  2 

TABLE  5  -  imagery  with  level  3  pixels  in  cyan  for  IMAGE  2 

TABLE  6  -  imagery  with  level  4  pixels  in  yellow  for  IMAGE  2 

TABLE  7  -  level  codes  in  color 

Blink  vectors  for  pertinent  images: 

IMAGE  1  -  0,  1,  0,  i,  0,  I,  0,  I 

IMAGE  2  -  1,  2,  3,  4,  5,  6,  7,  ) 

DEVICES:  A  device  is  a  LSC  input  device.  Devices  can  be  linked 

to  SCREENS,  then  an  input  from  that  device  will  cause  that 
screen  to  be  displayed. 

DEVICE  I  -  LSC  keyboard 

DEVICE  2  -  trackball  (one  trackball  may  be  eliminated) 

DEVICE  3  -  trackball 


The  pertinent  commands  which  DCON  accepts  are  listed  below.  If  the  keys  are 
pressed  in  the  order  shown  (from  left  to  right),  the  system  will  perform  the 
adjacent  function. 


CROSS: 

SCREEN: 


Func  t ion 


links  screen  X  to  image  V 

Z  I  links  device  X  to  screens 
;  Y  and  Z  (devices  can  be  linked 
to  I  to  3  screens) 

cause  the  screens  linked  to  the 
keyboard  to  have  cursor  mode  V. 

The  cursor  modes  possible  (where 
V  -  CROSS,  V  -  SCREEN,  etc.),  are 

trackball  and  arrows  will  move  the 
cursor  about  the  image 

trackball  and  arrows  will  pan  the 
screen  across  the  image  (this  is 
usually  used  with  the  image  soomed) 


Figure  5-4.  User  Commands  for  Image  Display  Utilities 


Function 


Zoom 

Mode 


Output 

Mode 


Blink 

Step 


Auto 

Blink 


fcleer 


Back 

Space 


Skip 


Keyboard  Sequence 


WRITE  DOTS:  this  is  the  same  as  the  cross  mode 
except  that  in  this  case  a 
trail  of  dots  will  be  left  by  the 
cursor 

ERASE  DOTS:  this  is  the  same  as  the  cross  mode 

except  that  now  the  cursor  can  erase 
dots 

LINE:  trackball  and  arrows  will  move 

one  end  of  a  line  extending  the 
position  of  the  last  cursor 
mode  update  to  the  current 
cursor  position. 

ZOOM:  trackball  and  arrows  will  room 

the  image 

X:  limits  cursor  motion  to  the  X 

direction 

Y:  limits  cursor  motion  to  the 

Y  direction 

XY:  restores  cursor  motion  to  both 

the  X  and  Y  directions 

TILT:  trackball  and  arrows  tilt  the 

image 

causes  images  linked  to  screens 
linked  to  the  keyboard  to  be 
zoomed  to  the  specified  level 
and  displayed 

causes  images  linked  to  screens  linktd 
to  the  keyboard  to  be  displayed 
using  the  look-up  table  indicated 
by  position  X  in  their  blink  vector. 

cause  images  linked  to  screens 
linked  to  the  keyboard  to  be  dis¬ 
played  using  the  next  look-up 
table  indicated  by  their  blink  vector 

causes  images  linked  to  screens 
linked  to  the  keyboard  to  blink 
step  automatically  at  the  preset 
time  intervals. 

Clears  the  input  line. 

backspaces  the  input  line  one 
character . 


■kips  forward  one  character  on 
the  input  line. 


Figure  5-4.  User  Commands  for  Image  Display  Utilities 
(continued) 


5.3.1  Initialization 


The  initialization  is  carried  out  through  user  interaction  with  the 
1700  on  the  operator's  CRT  and  keyboard. 

RUN  PREMAPS  under  the  INDIAN2  subsystem  of  MSOS;  this  loads 
th«  appropriate  look-up  tables  and  image  formats. 

-  LOAD  IMAGERY  using  INDIAN2  utilities.  (for  tape:  IMDSKA3; 
for  SMD:  DEMO,  DISPLA;  for  film:  SCN,  SCNTFR) 

RUN  MAPS  under  INDIAN2;  this  loads  the  MAPS  microcode. 

5.3.2  Interaction 


The  remaining  interaction  takes  place  directly  with  the  PP  array  on 
the  LSC  keyboard  and  trackball.  The  interaction  proceeds  in  two  phases: 

T  selection  and  area  definition.  Information  and  prompts  as  well  as  user 
inputs  are  displayed  in  color  on  the  original  image  throughout  both  phases. 
(Note:  DCON's  interpretation  of  keyboard  inputs  is  sometimes  dependent  on 

previous  inputs;  to  negate  this  possibility,  press  the  RESET  key  before 
making  inputs.)  A  table  of  T^  values  is  displayed  in  the  upper  left  hand 
corner  of  the  original  image. 

5.3.2.  1  Contrast  Scale  Selection 

Tq  SELECTION  is  indicated  by  the  message  INPUT  T^  VALUE  displayed 
in  the  lower  left  corner  of  the  original  image. 

A  pointer,  ">",  is  displayed  to  the  left  of  the  table  entry  to 
be  changed  by  the  current  input.  Initially  the  pointer  is  displayed 
next  to  the  Tq  (0)  entry.  After  each  input,  the  pointer  advances 
to  the  next  entry  until  all  four  entries  have  been  treated;  then 
operation  proceeds  to  the  area  definition  phase. 
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-  To  change  the  indicated  Tq  value:  input  a  two  digit  integer 
(inputs  must  be  two  digits:  01=1  etc.),  then  SEND.  The  new 
Tq  value  will  appear  in  the  table. 

-  To  by-pass  the  indicated  To  value:  just  SEND.  The  pointer  will 
advance  without  changing  any  table  entries. 

5. 3. 2. 2  Macro-Fidelity  Area  Definition 

-  AREA  DEFINITION  is  indicated  by  the  message  HOLD,  MARK,  SEND,  GO  in 
the  lower  left  corner  of  the  original  image.  The  cursor  should  be 
turned  on  during  the  area  definition  phase.  There  are  four  meaningful 
keyboard  inputs  during  area  definition:  M,  H,  SEND,  G. 

-  A  pointer,  ">",  is  displayed  next  to  the  T^  entry  to  be  applied 
to  area  definition. 

M  (mark)  followed  by  SEND  will  cause  the  FP  to  start  marking 

blocks;  whatever  block  the  cursor  enters  will  be  given  a  color 

outline,  the  same  color  as  the  currently  indicated  T^  entry. 

This  specifies  that  this  block  be  compressed  using  the  currently 

indicated  Tq  value  (the  default  values  for  B,  F,  and  A  are  3., 

.5,  .1  respectively).  Initially  no  blocks  are  marked;  this 

situation  means  that  T  (0)  will  be  used  for  all  blocks. 

o 

(Although  the  To  (0)  entry  is  white,  the  blocks  are  not  outlined. 
Hence  marking  with  Tq  (0),  indicated  by  the  pointer,  will  actually 
erase  any  marked  blocks  encountered). 

H  (hold)  followed  by  SEND  will  cause  the  FP  to  stop  marking 
blocks  but  will  not  advance  the  pointer.  This  allows  the  user  to 
mark  a  disconnected  area  with  the  same  color. 

-  SEND  alone  will  cause  the  pointer  to  advance  to  the  next  T 

o 

entry.  The  table  is  essentially  circular  during  area  definition; 
that  is  after  Tq  (3)  the  pointer  advances  to  Tq  (0).  Additionally, 
SEND  alone,  will  cause  the  FP  to  hold  if  it  is  presently  marking. 


-  G  (go)  followed  by  SEND  will  cause  the  FP  to  stop  area 
definition  and  compress  and  decompress  the  image.  Upon  completion, 
the  compression  ratio  is  displayed  to  the  right  of  the  Tq  (0) 
table  entry.  (The  compression  ratio  displayed  is  for  compression 
of  5  bit  pixels  to  8  bit  pixels,  the  compression  ratio  would  be 
about  7  percent  larger  for  6  bit  to  9  bit  compression). 

-  At  this  point  the  message  CLEAR  AREAS?  will  appear  in  the  left 
lower  corner  of  the  original  image. 

-  Y  (yes)  followed  by  SEND  will  clear  the  defined  areas  and 
return  to  selection  phase. 

-  N  (no)  followed  by  SEND  will  return  to  Tq  selection  with  the 
defined  areas  intact. 

SEND  alone  will  stop  the  program  and  return  the  background 
schedule  to  DCON's  control.  This  is  necessary  to  load  imagery. 

5.4  DEMONSTRATION  EXAMPLES 


Figures  5-5,  5-6,  and  5-7  show  examples  of  images  which  have  been 
compressed  with  the  MAPS  algorithm.  The  figures  show  the  original  imagery  and 
imagery  processed  with  and  without  macrofidelity  control  at  a  variety  of 
compression  ratios.  A  'map'  of  compression  is  created  with  color  graphics 
displaying  the  resolution  codes  of  the  output  pixels.  This  technique 
demonstrates  the  adaptability  of  the  MAPS  algorithm  and  provides  insight 
into  its  current  and  future  applications.  The  interpretation  of  the  colors  is 
given  in  Table  5-1. 

5.4.1  Graphics  at  Uniform  Fidelity 

Figure  5-5  shows  the  power  plant  original  with  and  without  graphics 
and  a  version  at  5.2  to  1  compression  displayed  with  7  different  look¬ 
up  tables.  No  macrofidelity  was  used  on  this  compression,  so  only  the  Tq  (0) 
parameter  is  used.  Frames  C  and  A  show  the  original  image  with  and  without 


TABLE  5-1.  COLOR  CODES  FOR  RESOLUTION  CODE  DISPLAY 


Color 

- - - - - - 

Meaning 

Green 

level  0  pixels  (1  pixel  x  1  pixel  ,  .625  compression  ratio) 

Red 

level  1  pixels  (2  pixels  x  2  pixels.  2.5  compression  ratio) 

Magenta 

level  2  pixels  (A  pixels  x  4  pixels,  10.  compression  ratio) 

Cyan 

level  3  pixels  (8  pixels  x  8  pixels,  40.  compression  ratio) 

Yellow 

level  4  pixels  (16  pixels x  16  pixels, 160.  compression  ratio) 

Figure  5-5. 
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Uniform  MAPS  Fidelity,  Graphics  Examples 
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Graphics  Examples  (continued) 
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LEVEL  2  PIXELS  LEVEL  3  PIXELS 


color  graphics;  frame  C  shows  Che  display  as  the  system  waits  for  a  new 
T  (0)  value  to  be  input  during  the  Tq  selection  phase.  Frames  B  and  D 
through  H  show  the  compressed  image  which  has  been  converted  using  seven 
different  look-up  tables. 

5.4.2  Compression  Ratio  Variation 

Figure  5-6  shows  the  BUILDING  scene  at  three  different  compression 
levels,  without  the  use  of  macrofidelity  control.  Each  compression  level 
is  represented  by  two  frames  showing  the  output  imagery  and  the  resolution 
codes.  The  resolution  codes  in  these  images  indicate  the  potential  for 
region  growing  and  edge  detection  using  MAPS.  Frames  B  and  F  represent  a 
compression  ratio  of  1.97  and  Tq  =4,  C  and  G  represent  a  5.2  to  1  compression 
with  Tq  =  12  and,  D  and  H  show  10.4  to  1  compression  using  Tq  =  25. 

5.4.3  Macro-Fidelity  Variation  with  Split  Screen,  Zoom 

Figure  5-7  shows  the  AERIAL  PHOTO  and  contrasts  compression  with  and 
without  macrofidelity  control.  Frames  B  and  F  show  the  image  compressed 
6.8  to  1  with  no  macrof idelity  controls.  Frames  D  and  H  show  the  image 
compressed  6.8  to  1  with  macrofidelity  controls  to  preserve  the  area  around 
the  terminal.  The  degree  of  preservation  is  vividly  displayed  in  the 
resolution  codes  in  frame  H.  The  macrofidelity  controls  are  shown  in 
color  in  frame  C.  There  are  four  levels  of  fidelity  achieved  by  using 
four  Tq  values:  28  (no  color),  16  (yellow  boxes),  10  (cyan  boxes), 

4  (magenta  boxes).  Frames  E  show  a  split  screen  with  the  original  image 
on  top  at  a  zoom  level  of  3  and  the  image  in  frame  D  at  zoom  level  3  on 
the  bottom.  Frame  G  shows  the  image  in  frame  D  on  top  unzoomed  and  the 
image  in  frame  H  on  the  bottom  unzooraed. 
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RES.  CODES.C.R.-5.2  RES.  CODES,  C.R.-10.4 
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ORIGINAL  WITH  GRAPHICS 
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MAPS  /  RES  CODES  RES.  CODES  WITH  CONTROLS 


SECTION  SIX 
RECOMMENDATIONS 


TRANSPORTABLE  SOFTWARE 


Implementation  of  MAPS  in  microcode  on  various  high-speed  image 
processing  systems  will  be  critically  dependent  on  the  architecture, 
instruction  set,  and  capabilities  of  each  particular  system.  However, 
the  generic  considerations  described  in  section  5.2  and  the  special  con¬ 
sideration  outlined  in  Appendix  B  should  provide  useful  guidance. 

For  more  general  familiarization  and  exploration  of  the  MAPS  technique, 
however,  preparation  of  a  "transportable  software"  version  written  in  a 
higher-order  language  (probably  FORTRAN)  is  recommended.  The  basic  MAPS 
concepts  are  sufficiently  mature  to  justify  such  formalization  and 
sufficient  options  should  be  included  to  provide  insight  into  the  scope  and 
diversity  of  the  technique.  An  outline  of  potential  options  for  inclusion 
in  the  implementation  is  included  as  Figure  6-1. 

MAPS  is  inherently  integer  and  arithmetically  simple  in  organization. 

The  principal  barriers  to  complete  transportability  thus  reside  in  inter¬ 
actions  with  word  size,  memory  capacity,  and  file  structure  in  the  host 
machine.  For  this  reason,  input  and  output  operations  and  pixel  decode/MAPSel 
encode  operations  should  be  broken  out  as  modular  routines.  Any  specific 
differences  of  a  particular  system  from  the  target  machine  will  then  be 
largely  localized  to  these  areas.  Also  impacting  these  areas  is  the 
requirement  that  the  source  and  MAPS  imagery  have  selectable  intensity  code 
lengths  of  six  or  eight  bits. 
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MAPS  OPTIONS 


Input/Output;  Pixel  Decode  (6  or  8  Bit) 
Image  Size/Section  Selection 


im  tt-Paoc/Miii  ti-Tmacc  PonrccctMc 

Ul*  I  i  I  I  (Ul-  '  1  ■  ‘  ‘  . . . 


a  i  in  \j  l. 


Mode  Selection:  compression  only 

compression/block  decompression 
compression/adaptive  decompression 

BLOCK  DECOMPRESSION  ONLY 
ADAPTIVE  DECOMPRESSION  ONLY 
"LEVEL"  IMAGE  DECOMPRESSION 
DIFFERENCE  IMAGE  (SIGNED,  AMPLIFIED) 


MAPS  Subframe  Selection:  8x8  or  16x16 


REARC/Selectablf  Macro-Fidelity  Control 
Micro-Fidelity  Control  Specification:  control  matrix 

MATRIX  GENERATORS 
CONTRAST  SCALE  ONLY 

Intensity  Partition/Reset  Option:  mean 

pseudo  median 

BIASED  MEDIAN 
EXTREME 

Adaptive  Decompression  Control:  convolution  weighting 

level  activation 

INTENSITY  ACTIVATION 

SHARPENING 

DITHER 


Image  Labelling:  tape 

MAPS  ANNOTATION 

Performance  Summarys:  compression  (ratio,  bits/pixel) 

LEVEL  HISTOGRAMS  U  OF  IMAGE) 
INTENSITY  HISTOGRAMS  (2-d) 
ERRORS  -  RMS,  MSE,  RMSE 


Figure  6-1.  Potential  User  Options,  MAPS 
Transportable  Software 


Image  size  should  be  user  selectable  along  with  the  ability  to 
"section"  the  image  by  skipping  in  a  specified  number  of  pixels  and  lines. 

In  addition,  the  user  should  be  able  to  achieve  multiple  passes  through  the 
same  image  at  varying  control  parameters  or  process  multiple  images  in 
sequence  on  the  source  file. 

A  variety  of  input/output  modes  should  be  available.  Among  these  are 
creation  of  a  file  containing  a  HAPS  image  in  compressed  form,  capability 
for  decompressing  such  an  image  in  either  the  BLOCK  or  ADAPTIVE  mode,  or 
compression  followed  immediately  by  decompression  in  either  tonal  image  mode. 
Generation  of  various  related  images  is  also  desirable;  for  example,  a 
"level"  image  where  each  resolution  code  is  displayed  as  a  selected  gray 
scale  and  difference  or  error  images.  The  latter  may  be  "signed"  differences 
biased  by  a  neutral  middle  gray  value  or  "amplified"  absolute  differences. 

In  the  area  of  MAPS  geometric  control,  the  user  should  have  the  option 
of  choosing  8x8  or  16x16  subframes  and  of  designating  various  subregions 
for  alternate  fidelity  control  with  a  REARC-like  (REdundant  ARea  Coding) 
coding  scheme. 

Micro-fidelity  control  options  should  include  specification  of  the 
contrast  control  matrix  directly,  generation  of  the  matrix  from  four 
parameters,  or  generation  from  the  contrast  scale  alone  with  the  other 
three  parameters  set  to  default  values  (B=3,  P=0.5,  A=0.1).  In  addition  to 
the  spatial  partition  of  the  image  for  macro-fidelity  variation,  an  intensity 
partition  capability  with  various  element  replacement  strategies  and  alternate 
fidelity  controls  should  be  included. 

For  the  ad  ive  decompression  mode,  the  user  should  be  able  to  supply 
a  weighting  function  or  select  from  several  internally  available,  and  to 
place  constraints  on  which  surround  elements  will  be  activated  according 
to  their  resolution  level  and  intensity  compared  with  the  target  element. 


Moreover,  a  selectable  "dither"  level  to  ma$k  contouring  should  be 
incorporated . 


Two  types  of  labelling  should  be  supplied.  The  first  is  a  file 
header  record  which  gives  the  name  and  size  of  the  image,  the  mode 
(compressed,  decompressed,  or  evaluation),  and  other  control  options 
exercised.  The  second  should  allow  for  alphanumerics  to  be  overlaid 
directly  on  the  image  bit  stream  for  hard  or  soft  copy  visual  annotation. 

Finally,  a  variety  of  performance  summaries  related  to  intensity  and 
resolution  distributions,  compression  levels,  and  intensity  errors  should 
be  reported  as  part  of  the  output  listing. 

A  software  package  with  these  features  would  provide  services 
ranging  from  those  of  a  basic  tool  for  further  research  to  a  user 
capability  for  compact  storage  of  a  significant  data  base  of  digital  imagery. 
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Appendix  A 


A.O  FLEXIBLE  PROCESSOR  AND  SCAN  CONVERTER  MEMORY 


CONTROL  DATA  1.0  HARDWARE  AND 

FLEXIBLE  PROCESSOR  SOFTWARE  DESCRIPTION 


The  Control  Data  Flexible  Processor 
is  a  digital  microprogrammable 
processor  which  has  been  designed 
specifically  for  multidimensional 
array  processing  Since  the  units  are 
microprogrammable  they  combine 
the  advantages  of  special-purpose 
hardware  in  efficiency  and  speed 
of  software  changes  to  the  compu¬ 
tational  algorithms. 

Each  Flexible  Processor  can  be  used 
as  a  building  block  in  a  modular 
system  design  where  each  Flexible 
Processor  is  accordingly  pro¬ 
grammed  with  appropriate  algorithms 
to  perform  specific  tasks  which  are 
assigned  to  it  Moreover  program¬ 
ming  of  the  various  Flexible 
Processors  in  an  array  can  be 
changed  dynamically  under  control 
of  a  processing  system  which  calls 
prescribed  programs  from  memory, 
as  from  a  rotating  disk  tile.  The  size 
of  the  Flexible  Processors  has  been 
effectively  chosen  to  permit 
efficient  construction  of  a  complete 
system  tailored  to  meet  project 
requirements. 

The  unique  features  of  the  Flexible 
Processor  make  it  ideally  suited  for 
systems  applications  in  a  wide 
variety  of  scientific  disciplines  One 
such  area  of  application  is  digital 
image  processing  Typical  computa¬ 
tional  functions  which  can  be  solved 
with  this  processor  include  image 
matching,  correlation,  spatial  trans¬ 
formation.  registration,  radiometric 
corrections,  change  detection, 
statistical  classification,  and  various 
enhancements  Applications  in  the 
field  of  image  processing  include 
cartography,  reconnaissance,  man¬ 
agement  of  earth  resources, 
non-destructive  testing  and  bio¬ 
technology  Additionally,  the 
Flexible  Processor  is  ideally  suited 
tor  control  of  image  display  and 
recording  equipment. 

The  paragraphs  which  follow 
describe  the  technical  characteris¬ 
tics.  programming  and  uses  of  the 
Flexible  Processor 


The  Flexible  Processor  is  a  specials 
purpose  computing  unit  featuring 
high  arithmetic  computation  rates, 
considerable  character-handling 
capabilities,  an  advanced  input- 
output  structure  and  semiconductor 
register  file  memories  for  data 
storage  Each  unit  features  arithmetic 
logic  capable  of  a  0  125  micro¬ 
second  addition  of  16-bit  or  32-bit 
operands,  a  0.250  microsecond  fixed 
point  multiply  of  8-bit  bytes,  and  a 
1.125  microsecond  fixed  point 
multiply  of  16-bit  operands 
(TABLE  I) 

TABLE  t.  CDC  FLEXIBLE  PROCESSOR  CHARACTERISTICS 

.  MICROPROGRAMMABLE  -  RANDOM  ACCESS  MICROCONTROL 
MEMORY 

.  32-BIT  OR  16-BIT  WORD  LENGTHS 

•  ARRAY  HARDWARE  MULTIPLIER 

•  16  LEVEL  HARDWARE  PRIORITY  INTERRUPT  MECHANISM  -  3 
LEVEL  MASK  CAPABILITY 

.  SPECIALIZED  LOGIC  FOR  SQUARE  ROOT  AND  DIVIDE 

•  8  mHz  FILE  BUFFERED  WORD  TRANSFER  RATE  -  16  WORD  BY 
32-BIT  OR  16-BlT  INPUT  FILE  BUFFER 

>  2  mHz  OIRECT  MEMORY  ACCESS  WORD  TRANSFER  RATE 

.  1  mHz  REGISTER-BUFFERED  WORD  TRANSFER  RATES 

•  OUAL  16-BIT  INTERNAL  DATA  BUS  SYSTEM 

•  o  125  fts  clock  cycle 

.  0  125  *s  32-BIT  ADDITION  0  250  ?s  BYTE  MULTIPLICATION 

.  REGISTER  FILE  CAPACITY  UP  TO  4128  SIXTEEN-BIT  WORDS 

.  HARDWARE  NETWORK  FOR  CONDITIONAL  MICROINSTRUCTION 
EXECUTION  -  4  MASK  REGISTERS  AND  A  CONDITION  HOLD 
REGISTER 
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The  Flexible  Processor  is  a  dual  bus 
organized  machine  with  a  modular 
set  of  functional  units  centered 
around  a  control  section  including 
conditional  instruction  execution 
networks,  interrupt  hardware,  and 
featuring  a  read  /write  semiconductor 
micro-memory  (Figure  t)  The  micro¬ 
memory  word  contains  both  direct 
control  functions  and  decoded  bus 
controls  Movement  of  operands 
among  the  functional  units  is  particu¬ 
larly  effective  in  applications  which 
require  a  high  data  throughput  as 
m  image  processing 

1.1  Functional  Units 

Three  basic  functions  comprise  ihe 
operat.cn  of  the  Fie*.bie  Processor 
Arithmetic  Rea-ster  File  Storage 
and  input 'Output  These  are  de¬ 
served  as  follows 

1.1.1  Arithmetic 

Arithmetic  functional  units  are  o‘  two 
k  nc-  A'lthmetiC  Log  c  Unit  (ALU! 
and  Hardware  Array  Multiplier 

Arithmetic  Logic  Unit 

This  unit  is  capable  o'  thirty  -mne 
unique  arithmetic  and  iopic  opera¬ 
tions  Sh.ftmg  of  af*  input  feeder 
reg'sfers  right  or  ie*t  vnfh  a  selection 
of  inputs  to  the  registers  dur-ng  the 
shift  instruction  and  a  "scale" 
capab-My  on  the  Output  o1  the  ALU 
extend  tne  carabines  o*  this 
funct  ona'  un>t  Tne  ALU  may  be 
con*  di.'ed  'natf  bit  or  30- b'l  format 
'one  and  two  cards  respectively) 

Hardware  Array  Multiplier 

Th»-  Ha*::w:iT  Ar-m  Mjf!  pi-C'  >s  a 

mr  d./a*  a . 'net  r  function  wh-rh  if. 

capab'n  o'  or :  by  eight  muft.p»es 
Wit1,  each  e«o*'  operand  rtirect'y 
se'ectab'c  from  two  sixteen  bit  input 
reg  >ters  Multipucat'On  is  performed 
asynchronous^  to  the  control  unit. 
a:  ow  ng  other  instruct  ons  to  be 
e»e'uted  while  the  multiplication 
is  taking  place 

1 .1.2  Register  File  Stonge 

The  internal  Register  File  Storage  is 
semiconductor  memory  providing 
both  Temporary  and  Large  File 
functions  (TABLE  ID  The  Temporary 
File  provides  16  words  of  16  bits 
earh  for  each  bus  This  Mo  has 
sepa’afc  read  and  write  address 
req-fters  allowing  simu'taneous  read 
and  write  capability  The  Large  File 
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FIGURE  1.  DATA  PATH  ORGANIZATION  IN  THE  CDC  FLEXIBLE  PROCESSOR 


TABLE  II.  FILE  STORAGE 


TYPE 

DESCRIPTION 

OPTIONS 

NUMBER  OF  WORDS 

X  16  BITS 

TEMP  FILE 

60  ns  semiconductor 

2-i6  word  f  tec 

Simu'taneous  Read  and  Write 

1-16  word  *  e 

16  b  is  per  chip 
l  dock  cycle  pe'  access 

none 

LARGE  FILE 

60  ns  so  - "conductor 

r-?048  vw-d  •  os 

Read  W.vie 

1  -2048  word  4  c 

?Sf'  O'  102-1  Bits  pef  Chip 

?ireo  word '  'or 

1  clock  cycle  per  access 

1- 1260  wo*d  ‘  .o 

2- 1024  word  files 

1  - 1024  wo'd  f-  e 

2-512  word 

1- 512  wend  file 

2- 256  wora  *  es 
i  -256  word  file 

none 
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provides  a  maximum  storage  of  2048 
words  of  16  bits  each  for  each  of 
the  two  buses. 

1.1.1  Input/Output 

The  Flexible  Processor  has  three 
types  of  external  data  transmission 
functional  units  available  These  are: 

•  Bi-Directional  Party-Line 
Channel  (AQ) 

This  channel  is  compatible  with  CDC 
1700  peripheral  equipment  and  has 
a  maximum  data  rate  capability  of 
one  megaword  per  second  (16  bit 
data  word)  There  is  a  maximum 
capacity  of  up  to  4  of  these  channels, 
however,  they  share  space  with  the 
DSA  channel 

•  External  Mass  Memory  Access 
Channel  (DSA) 

This  channel  is  primarily  intended  for 
use  with  an  MOS  semiconductor 
mass  memory.  This  channel  has  a 
data  rate  capability  of  two  mega¬ 
words  per  second  (16  bit  data  word) 
The  maximum  addressable  memory 
contains  over  one  million  sixteen 
bit  words  (20  address  bits  four  of 
which  are  used  for  bank  selection) 
There  is  a  maximum  of  three  of  these 
channels:  however,  one  channel  is 
forfeited  for  each  additional  AQ 
channel  in  the  Processor 

«  Inter-Flexible  Processor  Communi¬ 
cation  Channel 

This  functional  unit  permits  asyn¬ 
chronous  data  transmission  between 
Flexible  Processors  a!  8  megawords 
per  second  with  a  maximum  word 
length  of  32  bits  In  terms  of  the  bit 
transfer  rate,  the  maximum  commu¬ 
nication  rate  between  Flexible 
Processors  is  256  million  bits  per 
second  This  communication  channel 
is  comprised  of  two  dependent 
sections  One  section  is  located  in 
the  sending  Flexible  Processor,  and 
the  other  section  is  in  the  receiving 
Flexible  Processor  The  receiving 
section  has  a  sixteen  word  memory 
capable  of  simultaneous  read  and 
write  operations  enabling  trans¬ 
mission  asynchronous  to  the  receiv¬ 
ing  Flexible  Processor's  usage  ot  the 
operands  (TABLE  III).  Each  Flexible 
Processor  has  a  maximum  capacity 
of  two  16  bit  word  sending  sections 
and  two  16  bit  word  receiving  sec¬ 
tions  In  addition,  each  sending 
•action  can  communicate  with  as 
many  as  four  receiving  sections 


1.2  Miscellaneous  Hardware 
Capabilities 

Miscellaneous  hardware  capabilities 
of  the  Flexible  Processor  are  Loop 
Counters,  Return  Jump  File,  Micro¬ 
memory  Control  Storage,  and 
optional  External  Memory.  These 
capabilities  are  described  in  the 
following  paragraphs. 


capabilities  for  any  Flexible  Proces¬ 
sor  can  be  achieved  by  three  DSA 
channels  in  the  Flexible  Processor 
communicating  with  separate  ports 
of  unique  banks  of  memory. 


1.2.1  Loop  Counters 

Four  counters  are  provided  for 
software  problems  involving  iterative 
computation  There  ate  three  8-bit 
counters  and  one  16-bit  counter  with 
two  compare  registers  associated 
with  each  counter. 

1.2.2  Return  Jump  FUe 

A  return  jump  file  of  sixteen  words  is 
used  lor  subroutine  exits,  interrupt 
returns,  and  iterative  loop  returns. 
This  is  8  push  down-push  up  file 
capable  of  returning  control  to  a  main 
ptogram  through  a  maximum  ot 
sixteen  nested  loops  or  subroutines. 

1.2.3  Micromemory  Control  Storage 

The  micromemory  consists  ot  48-bit 
words  ot  random  access  read  and 
write  semiconductor  memory  with 
increments  from  256  words  to  1024 
words  tor  program  storage 

1X4  External  Memory 

A  MOS  semiconductor  memory  bank 
can  be  added  to  a  basic  Flexible 
Processor  by  adding  a  DSA  channel 
in  the  Flexible  Processor  and  one 
or  more  racks  o I  memory  (Figure  2) 
This  external  memory  is  expandable 
in  8192  word  increments  from  8192 
sixteen-bit  words  to  65536  sixtttn- 
bit  words  per  bank  with  a  maximum 
o(  sixteen  banks  per  DSA  channel 
This  memory  has  the  tapability  of 
multiport  operations  with  any  one 
port  having  a  data  rate  capability  of 
two  megawords  per  second  and 
multiport  operation  of  three  mega¬ 
words  per  second  Faster  memory 


TABLE  IH.  INPUT  STORAGE 


OPTIONS 

Type 

description 

NUMBER  OF  WORDS 

DV  IS  BITS 

Input  File 

•  60  ns  semiconductor 

2-16  word  files 

*  Simultaneous  Read  and  Write 

1-16  word  file 

•  16  bits  per  chip 

•  l  clock  cycle  per  items 

norm 
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1.3  Software 

As  slated  previously,  the  Flexible 
Processor  is  a  microprogrammable 
processor  with  read  and  write 
random  access  instruction  memory. 
Thus,  through  this  memory  the 
Flexible  Processor  is  encoded  to 
compute  a  desired  algorithm,  and  the 
memory  can  be  rewritten  subse¬ 
quently  to  perform  different  algo¬ 
rithms  if  it  is  so  desired. 

The  instruction  is  a  48-bit  word 
containing  both  decoded  and  direct 
control  fields  The  instruction  word 
defines  the  following  operations 

•  Simultaneous  control  of  the 
Arithmetic  Logic  Unit.  Multiplier, 
Jump  Stack.  Loop  Counter,  Condi¬ 
tional  Execution,  and  the  two  buses. 

•  independent  shifting  of  three 
Registers. 

•  Simultaneous  control  of  four 
Input/Output  Channels 

A  cross  assembler.  MPASS2.  has 
been  written  to  aid  in  the  generation 
of  microprograms  for  the  Flexible 
Processor  This  assembler  runs  on 
the  CDC  1700  computer  system 
utilizing  a  data  deck  that  has  a  one- 
to-one  correspondence  between  the 
micromnemonics  ana  the  micro- 
instruction  control  fields  A  symbolic 
addressing  capability  of  the 
assembler  also  eases  the  writing  of 
microprograms 

Other  available  software  routines  are: 

•  Library  routines  for  generation  of  a 
microprogram  library  on  disk  tile 

•  Loader  routine  for  loading  micro¬ 
programs  into  the  Flexible 
Processor  from  the  library  disk  file 

•  Diagnostics  for  all  functional  units 
in  the  Flexible  Processor 

•  Display  Station  Monitor  for  hard¬ 
ware  and  software  checkout  of  the 
Flexible  Processor  and  micro¬ 
programs. 


FIGURE  a.  MULTIPLE-PORT  DUAL-BANK  EXTERNAL  MEMORY 


1.4.1  Mechanical  Configuration 

The  Flexible  Processor  functional 
units  and  control  unit  are  contained 
within  a  card  cage  that  fits  into  a 
standard  19  inch  relay  rack  The 
dimensions  of  the  card  cage  are: 

•  Length  19  inches  (482  millimeters) 

•  Height  7  883  inches 
(200  millimeters) 

•  Depth:  12  inches  (305  millimeters) 

The  card  cage  contains  forty-one 
120  pin  edge-board  connectors  that 
have  a  standard  mechanical  and  wire 
wrap  configuration  for  any  Flexible 
Processor. 


1.4.2  Cooling  Requirements 

The  Flexible  Processor  is  forced-air 
cooled  Each  card  module  location  of 
the  Flexible  Processor  shall  receive 
450  lineal  feet  (117  meters)  per 
minute  of  forced  air  entering  the  FP 
from  below  the  logic  rack  through 
the  card  guides. 

1.4.3  Power  Requirements 

The  (tower  requirements  for  the 
Flexible  Processor  in  a  basic 
configuration  are  typically: 

•  +5VDC  rt  5%  @  45  amperes 

•  — 5VDC  d:  5%  @  3  amperes 


1.4  Physical  Description 

Another  attractive  feature  of  the 
Flexible  Processor  is  that  site  require 
ments  are  minimal  The  mechanical 
configuration,  cooling  requirements 
and  power  requirements  are  de¬ 
scribed  in  the  following  paragraphs. 


2.0  PIPE-LINE  AND 
OFF-LOADING  PROCESSING 

Use  of  the  Flexible  Processor  falls 
into  two  major  system  philosophies: 

•  Pipe-line  processing 

•  Off-loading  from  a  general-purpose 
computer 

The  Flexible  Processor  was  specifi¬ 
cally  designed  to  process  image  data 
in  a  pipe-line  mode,  thus  making 
possible  very  high  data  rates.  In  this 
system  concept  the  process  flow 
involving  the  data  proceeds  directly 
through  a  special  purpose  processor 
constructed  of  an  array  of  Flexible 
Processors  (Figure  3).  Process 
control  is  effected  with  a  general 
purpose  computer  or  a  special  con¬ 
troller  constructed  of  Flexible 
Processors. 

In  other  instances  it  is  convenient  to 
off-load  burdensome  computations 
from  a  general  purpose  computer  to 
an  array  of  Flexible  Processors 
(Figure  4)  This  is  done  where  it  is 
desired  to  perform  computation  on 
the  data  in  a  general-purpose  com¬ 
puter.  but  it  is  found  that  certain 
computations  are  particularly  burden¬ 
some  to  the  central  processor  Then 
total  system  performance  can  be 
greatly  improved  by  off-loading  these 
computations  to  an  array  of  Flexible 
Processors. 

As  was  described  previously,  each 
Flexible  Processor  can  communicate 
with  another  Flexible  Processor,  with 
a  host  computer,  and  with  external 
memory.  This  is  illustrated  in  Figure  5 
for  a  standard  packaging  of  4 
Flexible  Processors  jind  144K  of 
external  MOS  memory.  The  Flexible 
Processors  can  operate  in  series  or 
parallel  combination  to  meet  the 
process  requirements.  Notation  in 
Figure  5  is  as  follows: 

FP  —  Rexible  Processor 
IF  —  Input  File 
OR  —  Output  Register 
AQ—  Party  Line  Transmission 
Channel 

DSA  —  External  Memory  Access 
Transmission  Channel 
MOS  —  Random  Access  Memory 
ST  —  Station 


FIGURE  S.  PIPELINE  PROCESSOR  CONFIGURATION 


FIGURE  A  OFF-LOADING  PROCESSOR  CONFIGURATION 
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3.0  CONTROLLER  AND 
PROCESSOR  FUNCTIONS 

Uses  of  the  Flexible  Processor  In 
image  processing  applications  can 
be  divided  broadly  into  the  following 
three  categories: 

•  Preprocessor 

•  Applications  Processor 

•  Digital  Controller  for  Image  Display 
and  Recording  Equipment 

In  each  of  these  areas  many  benefits 
accrue  from  processing  the  image 
data  in  digital  form.  A  precision  and 
complexity  of  manipulations  can  be 
attained  that  is  difficult,  if  not  some¬ 
times  impossible,  to  achieve  in 
strictly  analog  fashion  Flexible  Proc¬ 
essors  have  been  used  for  image 
matching,  correlation,  spatial  trans¬ 
formation,  radiometric  correction,  and 
enhancement  The  built-in  memories 
together  with  additional  memory  are 
conveniently  used  for  table  look-up 
functions,  which  might  include  data 
corrections,  symbol  generation,  and 
alpha-numeric  generation.  Any  of 
these  items  may  appear  as  a  pre¬ 
processing  requirement  in  an  image 
processing  application. 

The  Applications  Processor  Is  here 
defined  as  that  processor  which 
performs  interpretive  functions  upon 
the  data  Typical  examples  are 
change  detection,  statistical  classifi¬ 
cation.  and  stereo  mapping  (TABLE 
IV)  Many  of  the  Applications 
Functions  may  be  performed  auto¬ 
matically.  while  others  may  be 
computed  as  a  result  of  operator 
Interaction 

In  many  instances  data  from  a 
number  of  sources  must  be  coordi¬ 
nated  at  an  image  display  or  record¬ 
ing  station  To  maintain  fidelity  of  the 
data  it  is  advantageous  to  use  a 
digital  controller  at  the  display  or 
image  recorder,  and  the  Flexible 
Processor  is  ideal  for  such  use 
(TABLE  V) 


TABLE  IV.  USE  OF  FLEXIBLE  PROCESSORS  FOR 
APPLICATIONS  PROCESSING 


•  CHANGE  DETECTION 

•  CARTOGRAPHY 

•  STATISTICAL  CLASSIFI¬ 
CATION 

•  TARGET  RECOGNITION 

•  TACTICAL  DEPLOYMENT 
CONCENTRATION 

•  MOVEMENT  VECTORS 

•  IMAGE  CORRELATION 

•  SUPERPOSITION  AND 
REGISTRATION 

•  GEOMETRIC  CORRECTION 

.  RADIOMETRIC  CORRECTION 


TABLE  V.  USE  OF  FLEXIBLE  PROCESSORS  Bl  MAGE 
DISPLAY  CONTROLLERS 


•  SCAN  CONVERSION 

.  ROUTINE  IMAGERY  COR¬ 
RECTION  WITH  ANCILLARY 
DATA 

•  GENERATION  AND  PLACE¬ 
MENT  OF  IDENTIFYING 
TARGET  SYMBOLS 

•  GENERATION  OF  ALPHA¬ 
NUMERIC  INFORMATION 

.  IMAGE  SCENE  SELECTION 

»  ENHANCEMENT  MODES 

•  TIMING  AND  CONTROL 
FUNCTIONS  FOR  DISPLAY 
EQUIPMENT 

•  GENERATION  OF  IMAGE 
COMPOSITES 


4.0  RELATED  EXAMPLES 

Three  examples  are  described  he* 
to  illustrate  the  versatility  and  data 
handling  capacity  of  flexible 
Processor  configurations.  The 
applications  described  are: 

•  Digital  Change  Detection 

•  Preprocessor  for  LANDSAT  (ERT5) 
Data 

•  Digital  Scan  Converter  Memory 
System 

The  following  examples  demonstrate 
the  capability  of  Flexible  Processor 
systems  to  perform  complex 
processing, functions  at  high  through¬ 
put  data  rates.  These  systems  are 
cost  effective  and  therefore  deserve 
attention  in  similar  applications 

4.1  Digital  Change  Detection 

The  4-Channel  Modular  Change 
Detection  System  performs  auto¬ 
matic  digital  change  detection  at  a 
nominal  processing  rate  of  830,000 
pixels  per  second  from  each  of 
two  input  images.  Each  pixel*  is 
encoded  to  8  bits,  hence  the  average 
processing  rate  exceeds  13  million 
bits  per  second.  The  system  was 
developed  in  a  program  with  the 
Rome  Air  Development  Center. 

Extraordinary  performance,  cost- 
effectiveness  and  growth  potential 
are  achieved  with  modular  archi¬ 
tecture  incorporating  an  array  of 
forty  Control  Data  Flexible  Proc¬ 
essors.  each  of  which  is  micro- 
programmable  Each  Flexible 
Processor  is  microcoded  to  perform 
a  specific  computational  algorithm 
which  is  assigned  to  il  High  speed 
interprocessor  communication 
and  data  transfer  permit  the  use  of 
combined  parallel  and  serial  con¬ 
figurations  yielding  optimum  system 
performance 

The  system  is  designed  to  perform 
change  detection  in  real  time.  The  two 
data  sets  are  matched  and  correlated 
in  a  totally  digital  mode  Then  the 
mission  image  data  is  spatially 
transformed  (digitally)  to  register 
precisely  with  a  reference  image  A 
difference  image  is  created  by 
subtracting  gray-scale  values  (tonal 
values)  of  the  mission  image  from  the 
reference  image  on  a  point-by-point 
basis. 


*A  Dtxvi  Is  a  plcturs  cell  or  I  maps  aampte 
slsmsnt 


This  difference  image  is  further 
enhanced  to  emphasize  difference 
detail  and  to  remove  noise  A  unique 
feature  is  false  alarm  suppression 
with  a  feature-oriented  processing 
technique. 

Processing  is  carried  out  in  four 
Change  Detection  Processors 
(Figure  6).  each  of  which  is  assigned 
to  one  of  four  image  channels 
There  are  9  Flexible  Processors  per 
channel  programmed  variously  for 
processing  algorithms.  2  Flexible 
Processors  for  output  control,  and  2 
Flexible  Processors  for  output 
overhead  (a  total  of  40  Flexible 
Processors)  A  large  digital  buffer 
stores  9  million  bits  of  mission 
image  data. 


Figure  6.  Change  Detection  Processor 
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-FEATURE  ORIENTED  PROCESSING 

FIGURE  7.  BLOCK  DIAGRAM  OF  CHANGE  DETECTION  PROCESSOR  (SINGLE  CHANNEL) 


Processing  of  image  data  proceeds 
in  pipeline  fashion  from  the  input 
source,  through  the  various  sections 
of  the  Change  Defection  Processor, 
and  to  output  devices  (Figure  7). 
Relative  image  distortions  are  cor¬ 
rected  via  a  feedback  control  loop 
which  operates  on  the  memory 
address  The  process  is  supervised 
with  a  Control  Data  SC- 1700  Com¬ 
puter  A  library  disk  provides  diag¬ 
nostic  and  real-time  algorithm 
firmware. 

Original  scene  and  difference  image 
data  can  be  written  on  any  one  of 
three  9-track  high  speed  digital  tape 
drives,  operating  at  8000  BPI.  These 
tape  units  can  also  be  used  as  input 
data  sources  to  the  system. 


4.2  Preprocessor  for 
LANDSAT (ERTS)  Data 

An  example  of  the  use  of  Flexible 
Processors  in  preprocessing  ot 
LANDSAT  (ERTS)  data  is  the  Terra 
Information  Processing  System 
(TIPS)  constructed  for  Teiespazio  in 
Italy.  This  system  will  process 
LANDSAT  and  airborne  remote  sens¬ 
ing  data  as  the  prime  application. 

TIPS  converts  satellite  image  data  to 
computer  compatible  tape  in  real 
time,  provides  both  visual  and  auto¬ 
matic  quality  control  checks  during 
the  process,  and  provides  a  capa¬ 
bility  for  subsequent  viewing,  editing, 
and  analysis  ot  the  imagery,  with 
final  output  on  either  computer- 


compatible  tape  or  film  transparen¬ 
cies  A  unique  feature  of  the  system 
is  the  Flexible  Processor  which 
performs  the  basic  corrections  and 
formatting  in  real  time  directly 
from  the  satellite  telemetry. 

The  TIPS  system  uses  a  high  per¬ 
formance  configuration  for  central 
control  (Figure  8)  A  wide  range  of 
input  data  formats,  rates,  and  pre¬ 
processing  functions  is  possible  with 
the  use  of  two  Flexible  Processors 
at  the  front  end  This  design  config¬ 
uration  provides  maximum  utilization 
ot  standard  proven  electronic  data 
processing  equipment,  and  the  very 
high  data  processing  rates  are 
achieved  through  the  use  of  the 
microprocessors  It  is  significant  that 


Figure  8.  Terra  Information  Processing  System  (TIPS) 
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the  microprocessors  may  be  repro¬ 
grammed  for  a  wide  range  of  tasks 
in  addition  to  the  processing  of 
digital  image  data. 

4.3  Digital  Scan 
Converter  Memory  System 

A  Digital  Scan  Converter  Memory 
System  provides  refresh  for  a  3-color 
video  display  system  at  an  average 
rate  of  78  million  bits  per  second 
The  image  frame  consists  of  St  2  lines 
of  640  pixels  per  line  with  each  pixel 
encoded  to  8  bits  The  image  is  line 
interleaved  and  is  refreshed  af  60 
fields  per  second  or  30  frames  per 
second.  The  system  configuration 
(Figure  9)  includes  a  CDC  Flexible 
Processor  and  external  memory 
which  performs  the  following  primary 
functions: 

•  Perform  controller  functions  such 
as  memory  address  computation, 
load  gray-scale  table  look-up 
memory,  etc. 

•  Load  and/or  modify  contents  of  the 
scan  converter  memory 


•  Translate  operator  inserted  key¬ 
board  commands  into  alpha¬ 
numeric  and  graphics  overlay  data 

The  capacity  of  the  scan  converter 
memory  is  640  pixels  per  line  by  512 
lines  per  frame  by  8  bits  per  pixel 
The  memory  is  organized  into  lour 
banks  each  having  a  capacity  of  4QK 
words  (K=l024)  by  16  bits  per 
word  with  two  eight  bit  pixels  packed 
into  each  word.  The  number  of 
banks  can  be  modulariy  expandable 
up  to  a  maximum  of  16  banks.  Thu* 
four  independent  640  x  512  x  8 
digital  scan  converters  could  be 
controlled  by  one  Flexible  Processor. 
With  some  modification,  this  memory 
capacity  could  be  extended  to  a 
single  high  resolution  display  of  1280 
x  1024  x  8.  In  addition,  each  bank 
is  expandable  to  a  maximum  capacity 
of  64K  x  16  Thus,  with  16  banks 
the  maximum  capacity  is  1048576 
words  (16-bits  each) 

Since  the  memory  is  random  access, 
it  may  also  serve  a  dual  role  as  an 
extended  capacity  random  access 


storage  tor  data  processing  calcula¬ 
tions  The  memory  cycle  time  for 
either  read  or  write  is  300  nano¬ 
seconds. 

Keyboard  and  trackball  or  light  pen 
inputs  are  translated  by  the  Flexible 
Processor  so  that  memory  contents 
can  be  appropriately  modified  to 
show  an  updated  cursor  position  on 
the  CRT  display  This  allows  image 
pixel  interrogation  with  the  cursor 
which  is  especially  useful  for  image 
analysis  and  interactive  editing 
Image  rooming  and  offsetting  is 
implemented  by  appropriate  key¬ 
board  entry  into  the  Flexible 
Processor 

Level  slicing  and  image  feature 
enhancement  is  implemented  by  a 
table-look-up  memory 
Scrolling  ot  continuous  Strip  images 
into  a  "moving  window"  format  from 
the  CRT  display  can  be  accommo¬ 
dated  by  keyboard  call  of  an 
appropriate  FP  microprogram 


Figure  9. 


Digital  Scan  Converter  Memory  System 
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Appendix  B 


B.O  SPECIAL  CODING  CONSIDERATIONS 

This  section  shows  the  micromemory  and  large  file  allocation  for  the 
MAPS  macrofidelity  control  program.  Figures  are  included  to  show  the 
derivation  of  the  MAPS  ordering  lookup  table  and  the  sorting  lookup  table. 

A  glossary  of  table  and  routine  names  is  also  included. 

B. 1  Micromemory  and  Large  File  Usage 

The  entire  MAPS  overlay  requires  710  ($AC8)  words  of  micromemory. 

* 

It  is  an  overlay  to  the  DCON  program  and  requires  several  DCON  routines  in 
order  to  function.  A  map  of  micromemory  is  shown  in  figure  B-l. 

Approximately  2/3  of  the  micromemory  required  is  used  to  support  the  inter¬ 
active  capabilities  and  the  remainder  holds  the  compression  and  decompression 
routines.  The  overlay  requires  310  ($136)  words  of  large  file  0  and  303 
($52F)  words  of  large  file  1.  Figures  B-2  and  B-3  show  a  map  of  large  file 
usage.  Additionally  the  overlay  uses  the  Character  Generator  Parameter 
Tables  (CGPT)  in  DCON's  area  of  large  file.  A  complete  breakdown  of  require¬ 
ment  on  a  routine  basis  is  shown  in  figure  B-4 . 


*DC0N  —  Display  Controller 
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DCON-display  control 


FUN-driver 


OUTT-output  TO  table 
INTO-input  TO  values 

PNTE-pointer 
WAIT- wait  for  input 
DECI-decoae  integer 
TOEQ-output  TO  va’ue 
RBUK-read  buffer 
ARDF-area  definition 


F.  N  C  F -encode  fixed 
point  numbe  r 

OCK-output  C.R. 

1)  V  3  2  —  3  2  bit  divide 

MAP  X-MAP  S  driver 


COMB-com press  block 


REDB-read  block 
DECB-decompress  block 

WRTB-write  block 


Figure  B- J .  Micromemory  Map 


DCON-display  control 


400  MAPS  ordering  look¬ 
up  table 


481  sorting  lookup  table 


4C1  COMB  indirect  addr. 

4C3  TO ( 0 )  CCM 

4D3  TO ( 1 )  CCM 

4E3  TO ( 2 )  CCM 

4F3  TO ( 3 )  CCM 

503  ARDF  state  table 

50A  MES1  message  buffers 

510  MES2 

519  MES3 

524  MES4 

52F  MES5 


Figure  B-2.  Large  File 
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Name 

Location 

FUN 

802-849 

OUTT 

84A-853 

INTO 

854-88 1 

IliSlIiBill 

IRRH 

msm 

BISSII1 

T0EQ 

8BB-8DA 

RBUF 

8D3-8DD 

ARDF 

8DE-949 

Hi 

mm 

98B-9A3 

DV32 

9A4-9D8 

MAPS 

9D9-AOF 

COMB 

A10-A80 

REDB 

A81-A9E 

DECB 

A9F-AC2 

WRTB 

AC4-ADB 

510-519 

C3-502 


CCMS  4C3-502 
Indirect  4 C 1 


3DO-3DF 

OUTT,  INTO,  ARDF 

3EO-3EF 

C0F 1 ,  MAPS,  CONI, 

OCR,  DBUF,  WAIT, 

CLR,  CLRI,  CGO 1 

5)0-513 

500-50F 


EO-3EF 


DO-3DF 


3EO-3EF 

510-513 


3EO-3EF 

514-52F 


MYCB  3EO-3EF 


Indirect  530 


Pixels  4Q0-4FF 
Pixel  size  52B-52F 
Indirect  530 


Pixels  400-4 FF 


Pixels  400-4FF 
Pixel  size  52B-52F 


Pixels  400-4FF 


in 


PNTE,  CLR,  DBUF, 
DRAW 


WBUF 


DV32,  DBUF,  ENCF 


REDB,  COMB,  DECB, 
WRTB 


Figure  B-4 .  Detailed  Breakdown  of  Memory  Allocation 


B.2  MAPS  Ordering  Look  Up  Table 

Reading  and  writing  blocks  from  S.C.M.*  is  implemented  using  a  look  up 
table  stored  in  LFQ*  locations  400-480.  This  scheme  takes  advantage  of  the 
fact  that  16  pixels  will  be  taken  from  each  line  of  the  image.  It  also 
assumes  that  the  image  is  made  up  entirely  of  16  x  16  blocks  of  pixels  i.e. 
each  block's  starting  pixel  (number  1)  will  be  stored  in  the  high  order  byte 
of  bank  C  in  S.C.M.  So  to  read  the  16  pixels  in  the  first  line  of  a  block 


whose  starting  pixel  is  at 

address  n 

in  bank 

C: 

read  the  4 

pixels 

in 

n 

bank 

C 

n+1 

bank 

C 

then 

read  the  4 

pixels 

in 

n 

bank 

D 

n+ 1 

bank 

D 

then 

read  the  4 

pixels 

in 

n 

bank 

E 

n+1 

bank 

E 

then 

read  the  4 

pixels 

in 

n 

bank 

F 

n+1 

bank 

F 

Now  reset  n  to  the  address  of  the  first  pixel  in  line  2  and  iterate  until 
16  lines  have  been  read.  (The  reason  the  address  is  incremented  before  the 
bank  is  that  this  increment  takes  place  automatically  at  each  DSA*  read.)  A 
table  showing  MAPS  order  is  shown  in  figure  B-5. 


*SCM  —  Scan  Converter  Memory 
LFO  —  Large  file  zero 
USA  —  Direct  Storage  Access 
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in  the  following  order 
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Figure  B-5.  Derivation  of  MAPS  Ordering  Look-Up  Table 


B.3  Sorting  Lookup  Table 


The  sort  of  4  pixels  performed  in  COMB  is  achieved  using  a  lookup 
table.  The  4  pixels  are  located  in  TF1*  locations  0-3.  All  six  possible 
differences  are  taken  and  stored  in  TFO*  locations  0-5.  The  differences  are 
taken  in  the  following  order: 


P  -P 
o 

Po-F 

P  -P 
o 


Vp 

prp 

prp 


1 

2 
3 
3 
3 
2 


The  reason  this  order  was  chosen  is  that  this  order  minimizes  the  number  of 
changes  to  the  input  registers  of  the  adder.  The  sign  bit  of  each  difference 
is  shifted  into  a  register  forming  a  6  bit  address.  This  address  is  used  to 
look  up  the  addresses  of  the  extreme,  middle,  low,  and  high  steps.  Figure  B-6 
shows  how  the  look  up  table  is  generated.  The  table  occupies  64  locations  in 
LFO*  but  only  24  are  used.  (The  Ad  column  of  the  figure  shows  the  offset 
into  the  table  of  the  required  addresses  shown  in  column  HMLE.  The  column 
marked  ORDER  shows  the  accual  order  of  the  pixels.) 


*TF0  —  Temporary  file  zero 
TF1  —  Temporary  file  one 
LFO  —  Large  file  zero 
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Figure  B-6.  Derivation  of  Sorting 
Look  Up  Table 


Ad  HMLE  ORDER 


00  0532 


01  1542 


03  1340 


11  1043 


13  1245 


IB  3205 


04  0431 


06  2451 


07  2350 


0E  2053 


OF  2154 


IF  3104 


20  0134 


30  5124 
38  5320 


31  5023 


39  5421 


3B  3401 
24  0235 


2C  4215 


3C  4310 


2E  4013 


3E  4512 
3F  3502 


TABLE  B-l 
Glossary 


ARDF 

- 

(MAPS) 

Area  definition  routine 

ASCI 

- 

(LF1  ) 

TO  values  stored  in  ASCII 

BASE 

- 

(LF1  ) 

Base  Contrast  Control  Matrix 

BCNT 

- 

(LF1  ) 

Block  count  (number  of  compressed  pixels) 

CCMS 

- 

(LFO  ) 

Table  of  4  CCMS 

CGO  1 

- 

(DCON) 

Generates  one  character 

CLR 

- 

( DCON ) 

Clears  a  line  of  characters 

CLRI 

- 

(DCON) 

Clears  an  image 

COF 1 

- 

(DCON) 

Turns  cursor  off 

COMB 

- 

(MAPS) 

Compresses  a  block  of  pixels 

CONI 

- 

(DCON) 

Turns  cursor  on 

DBUF 

- 

(DCON) 

Dumps  buffer  of  characters 

DECB 

- 

(MAPS) 

Decompresses  a  block  of  pixels 

DEC  I 

- 

(MAPS) 

Decodes  an  integer  in  ASCII 

DRAW 

- 

(DCON) 

Draws  lines 

DV32 

- 

(MAPS) 

32  bit  divide 

ENCF 

- 

(MAPS) 

Encode  a  fixed  point  number  into  ASCII 

FRAM 

- 

(LFJ  ) 

Line  descripter  table  for  DRAW 

FUN 

- 

(MAPS) 

Macro  Fidelity  executive  routine 

HSCG 

- 

(LF1  ) 

DCON '  s  CGPT 

INTO 

- 

(MAPS) 

Accepts  TO  input  from  LSC  keyboard 

MAPO 

- 

(LFO  ) 

MAPS  ordering  lookup  table 

MAPS 

- 

(MAPS) 

Compression  and  decompression  executive 

MES1 

- 

(LFO  ) 

"TO  (0)  -  00" 

93 


TABLE  B-l 
(continued) 


HES2 

- 

(LFO  ) 

"INPUT  TO  VALUE" 

MES3 

- 

(LFO  ) 

"HOLD,  GO,  MARK,  SEND” 

MES4 

- 

(LFO  ) 

"C.  R.  =  " 

MESS 

- 

(LFO  ) 

"CLEAR  AREAS?" 

MSP 

- 

(DCON) 

16  x  16  bit  multiply 

MYCG 

- 

(LF1  ) 

MAPS'S  CGPT 

OCR 

- 

(MAPS) 

Output  compression  ratio 

OUTT 

(MAPS) 

Output  table  of  TO  values 

PNTE 

- 

(MAPS) 

Display  ">"  at  table  entry 

RBUF 

- 

(MAPS) 

Read  character  from  buffer 

REDB 

- 

(MAPS) 

Reads  a  block  of  pixels  from  SCM 

SORT 

- 

(LFO  ) 

Sorting  lookup  table 

STAT 

- 

(LFO  ) 

Area  definition  state  table 

TOEQ 

- 

(MAPS) 

Output  single  TO  value 

WAIT 

- 

(MAPS) 

Wait  for  keyboard  input 

WBUF 

- 

(DCON) 

Write  character  into  buffer 

WRTB 

- 

(MAPS) 

Write  block  of  pixels 

94 


•  fc* 


Appendix  C 


Selected  Microcode  Source 


Shown  here  is ' the  source  microcode  which  perform  MAPS  compression  and 
decompression.  Included  are  MAPS,  COMB,  REDB,  DECB,  and  WRTB. 
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